{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# Character Sequence to Sequence \n",
    "In this notebook, we'll build a model that takes in a sequence of letters, and outputs a sorted version of that sequence. We'll do that using what we've learned so far about Sequence to Sequence models.\n",
    "\n",
    "<img src=\"images/sequence-to-sequence.jpg\"/>\n",
    "\n",
    "\n",
    "## Dataset \n",
    "\n",
    "The dataset lives in the /data/ folder. At the moment, it is made up of the following files:\n",
    " * **letters_source.txt**: The list of input letter sequences. Each sequence is its own line. \n",
    " * **letters_target.txt**: The list of target sequences we'll use in the training process. Each sequence here is a response to the input sequence in letters_source.txt with the same line number."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false,
    "scrolled": false
   },
   "outputs": [],
   "source": [
    "import helper\n",
    "\n",
    "source_path = 'data/letters_source.txt'\n",
    "target_path = 'data/letters_target.txt'\n",
    "\n",
    "source_sentences = helper.load_data(source_path)\n",
    "target_sentences = helper.load_data(target_path)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's start by examining the current state of the dataset. `source_sentences` contains the entire input sequence file as text delimited by newline symbols."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['bsaqq',\n",
       " 'npy',\n",
       " 'lbwuj',\n",
       " 'bqv',\n",
       " 'kial',\n",
       " 'tddam',\n",
       " 'edxpjpg',\n",
       " 'nspv',\n",
       " 'huloz',\n",
       " '']"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "source_sentences[:50].split('\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`target_sentences` contains the entire output sequence file as text delimited by newline symbols.  Each line corresponds to the line from `source_sentences`.  `target_sentences` contains a sorted characters of the line."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['abqqs',\n",
       " 'npy',\n",
       " 'bjluw',\n",
       " 'bqv',\n",
       " 'aikl',\n",
       " 'addmt',\n",
       " 'degjppx',\n",
       " 'npsv',\n",
       " 'hlouz',\n",
       " '']"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "target_sentences[:50].split('\\n')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Preprocess\n",
    "To do anything useful with it, we'll need to turn the characters into a list of integers: "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Example source sequence\n",
      "[[14, 4, 5, 26, 26], [22, 6, 17], [28, 14, 11, 27, 19]]\n",
      "\n",
      "\n",
      "Example target sequence\n",
      "[[5, 14, 26, 26, 4], [22, 6, 17], [14, 19, 28, 27, 11]]\n"
     ]
    }
   ],
   "source": [
    "def extract_character_vocab(data):\n",
    "    special_words = ['<pad>', '<unk>', '<s>',  '<\\s>']\n",
    "\n",
    "    set_words = set([character for line in data.split('\\n') for character in line])\n",
    "    int_to_vocab = {word_i: word for word_i, word in enumerate(special_words + list(set_words))}\n",
    "    vocab_to_int = {word: word_i for word_i, word in int_to_vocab.items()}\n",
    "\n",
    "    return int_to_vocab, vocab_to_int\n",
    "\n",
    "# Build int2letter and letter2int dicts\n",
    "source_int_to_letter, source_letter_to_int = extract_character_vocab(source_sentences)\n",
    "target_int_to_letter, target_letter_to_int = extract_character_vocab(target_sentences)\n",
    "\n",
    "# Convert characters to ids\n",
    "source_letter_ids = [[source_letter_to_int.get(letter, source_letter_to_int['<unk>']) for letter in line] for line in source_sentences.split('\\n')]\n",
    "target_letter_ids = [[target_letter_to_int.get(letter, target_letter_to_int['<unk>']) for letter in line] for line in target_sentences.split('\\n')]\n",
    "\n",
    "print(\"Example source sequence\")\n",
    "print(source_letter_ids[:3])\n",
    "print(\"\\n\")\n",
    "print(\"Example target sequence\")\n",
    "print(target_letter_ids[:3])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The last step in the preprocessing stage is to determine the the longest sequence size in the dataset we'll be using, then pad all the sequences to that length."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Sequence Length\n",
      "7\n",
      "\n",
      "\n",
      "Input sequence example\n",
      "[[14, 4, 5, 26, 26, 0, 0], [22, 6, 17, 0, 0, 0, 0], [28, 14, 11, 27, 19, 0, 0]]\n",
      "\n",
      "\n",
      "Target sequence example\n",
      "[[5, 14, 26, 26, 4, 0, 0], [22, 6, 17, 0, 0, 0, 0], [14, 19, 28, 27, 11, 0, 0]]\n"
     ]
    }
   ],
   "source": [
    "def pad_id_sequences(source_ids, source_letter_to_int, target_ids, target_letter_to_int, sequence_length):\n",
    "    new_source_ids = [sentence + [source_letter_to_int['<pad>']] * (sequence_length - len(sentence)) \\\n",
    "                      for sentence in source_ids]\n",
    "    new_target_ids = [sentence + [target_letter_to_int['<pad>']] * (sequence_length - len(sentence)) \\\n",
    "                      for sentence in target_ids]\n",
    "\n",
    "    return new_source_ids, new_target_ids\n",
    "\n",
    "\n",
    "# Use the longest sequence as sequence length\n",
    "sequence_length = max(\n",
    "        [len(sentence) for sentence in source_letter_ids] + [len(sentence) for sentence in target_letter_ids])\n",
    "\n",
    "# Pad all sequences up to sequence length\n",
    "source_ids, target_ids = pad_id_sequences(source_letter_ids, source_letter_to_int, \n",
    "                                          target_letter_ids, target_letter_to_int, sequence_length)\n",
    "\n",
    "print(\"Sequence Length\")\n",
    "print(sequence_length)\n",
    "print(\"\\n\")\n",
    "print(\"Input sequence example\")\n",
    "print(source_ids[:3])\n",
    "print(\"\\n\")\n",
    "print(\"Target sequence example\")\n",
    "print(target_ids[:3])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is the final shape we need them to be in. We can now proceed to building the model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Model\n",
    "#### Check the Version of TensorFlow\n",
    "This will check to make sure you have the correct version of TensorFlow"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "TensorFlow Version: 1.0.0\n"
     ]
    }
   ],
   "source": [
    "from distutils.version import LooseVersion\n",
    "import tensorflow as tf\n",
    "\n",
    "# Check TensorFlow Version\n",
    "assert LooseVersion(tf.__version__) >= LooseVersion('1.0'), 'Please use TensorFlow version 1.0 or newer'\n",
    "print('TensorFlow Version: {}'.format(tf.__version__))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Hyperparameters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Number of Epochs\n",
    "epochs = 60\n",
    "# Batch Size\n",
    "batch_size = 128\n",
    "# RNN Size\n",
    "rnn_size = 50\n",
    "# Number of Layers\n",
    "num_layers = 2\n",
    "# Embedding Size\n",
    "encoding_embedding_size = 13\n",
    "decoding_embedding_size = 13\n",
    "# Learning Rate\n",
    "learning_rate = 0.001"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Input"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "input_data = tf.placeholder(tf.int32, [batch_size, sequence_length])\n",
    "targets = tf.placeholder(tf.int32, [batch_size, sequence_length])\n",
    "lr = tf.placeholder(tf.float32)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Sequence to Sequence\n",
    "The decoder is probably the most complex part of this model. We need to declare a decoder for the training phase, and a decoder for the inference/prediction phase. These two decoders will share their parameters (so that all the weights and biases that are set during the training phase can be used when we deploy the model).\n",
    "\n",
    "\n",
    "First, we'll need to define the type of cell we'll be using for our decoder RNNs. We opted for LSTM.\n",
    "\n",
    "Then, we'll need to hookup a fully connected layer to the output of decoder. The output of this layer tells us which word the RNN is choosing to output at each time step.\n",
    "\n",
    "Let's first look at the inference/prediction decoder. It is the one we'll use when we deploy our chatbot to the wild (even though it comes second in the actual code).\n",
    "\n",
    "<img src=\"images/sequence-to-sequence-inference-decoder.png\"/>\n",
    "\n",
    "We'll hand our encoder hidden state to the inference decoder and have it process its output. TensorFlow handles most of the logic for us. We just have to use [`tf.contrib.seq2seq.simple_decoder_fn_inference`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/simple_decoder_fn_inference) and [`tf.contrib.seq2seq.dynamic_rnn_decoder`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder) and supply them with the appropriate inputs.\n",
    "\n",
    "Notice that the inference decoder feeds the output of each time step as an input to the next.\n",
    "\n",
    "As for the training decoder, we can think of it as looking like this:\n",
    "<img src=\"images/sequence-to-sequence-training-decoder.png\"/>\n",
    "\n",
    "The training decoder **does not** feed the output of each time step to the next. Rather, the inputs to the decoder time steps are the target sequence from the training dataset (the orange letters)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Encoding\n",
    "- Embed the input data using [`tf.contrib.layers.embed_sequence`](https://www.tensorflow.org/api_docs/python/tf/contrib/layers/embed_sequence)\n",
    "- Pass the embedded input into a stack of RNNs.  Save the RNN state and ignore the output."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "source_vocab_size = len(source_letter_to_int)\n",
    "\n",
    "# Encoder embedding\n",
    "enc_embed_input = tf.contrib.layers.embed_sequence(input_data, source_vocab_size, encoding_embedding_size)\n",
    "\n",
    "# Encoder\n",
    "enc_cell = tf.contrib.rnn.MultiRNNCell([tf.contrib.rnn.BasicLSTMCell(rnn_size)] * num_layers)\n",
    "_, enc_state = tf.nn.dynamic_rnn(enc_cell, enc_embed_input, dtype=tf.float32)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Process Decoding Input"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Targets\n",
      "[[ 0  1  2  3  4  5  6]\n",
      " [ 7  8  9 10 11 12 13]]\n",
      "\n",
      "\n",
      "Processed Decoding Input\n",
      "[[ 2  0  1  2  3  4  5]\n",
      " [ 2  7  8  9 10 11 12]]\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "\n",
    "# Process the input we'll feed to the decoder\n",
    "ending = tf.strided_slice(targets, [0, 0], [batch_size, -1], [1, 1])\n",
    "dec_input = tf.concat([tf.fill([batch_size, 1], target_letter_to_int['<s>']), ending], 1)\n",
    "\n",
    "demonstration_outputs = np.reshape(range(batch_size * sequence_length), (batch_size, sequence_length))\n",
    "\n",
    "sess = tf.InteractiveSession()\n",
    "print(\"Targets\")\n",
    "print(demonstration_outputs[:2])\n",
    "print(\"\\n\")\n",
    "print(\"Processed Decoding Input\")\n",
    "print(sess.run(dec_input, {targets: demonstration_outputs})[:2])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Decoding\n",
    "- Embed the decoding input\n",
    "- Build the decoding RNNs\n",
    "- Build the output layer in the decoding scope, so the weight and bias can be shared between the training and inference decoders."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "target_vocab_size = len(target_letter_to_int)\n",
    "\n",
    "# Decoder Embedding\n",
    "dec_embeddings = tf.Variable(tf.random_uniform([target_vocab_size, decoding_embedding_size]))\n",
    "dec_embed_input = tf.nn.embedding_lookup(dec_embeddings, dec_input)\n",
    "\n",
    "# Decoder RNNs\n",
    "dec_cell = tf.contrib.rnn.MultiRNNCell([tf.contrib.rnn.BasicLSTMCell(rnn_size)] * num_layers)\n",
    "\n",
    "with tf.variable_scope(\"decoding\") as decoding_scope:\n",
    "    # Output Layer\n",
    "    output_fn = lambda x: tf.contrib.layers.fully_connected(x, target_vocab_size, None, scope=decoding_scope)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Decoder During Training\n",
    "- Build the training decoder using [`tf.contrib.seq2seq.simple_decoder_fn_train`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/simple_decoder_fn_train) and [`tf.contrib.seq2seq.dynamic_rnn_decoder`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder).\n",
    "- Apply the output layer to the output of the training decoder"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "with tf.variable_scope(\"decoding\") as decoding_scope:\n",
    "    # Training Decoder\n",
    "    train_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_train(enc_state)\n",
    "    train_pred, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(\n",
    "        dec_cell, train_decoder_fn, dec_embed_input, sequence_length, scope=decoding_scope)\n",
    "    \n",
    "    # Apply output function\n",
    "    train_logits =  output_fn(train_pred)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Decoder During Inference\n",
    "- Reuse the weights the biases from the training decoder using [`tf.variable_scope(\"decoding\", reuse=True)`](https://www.tensorflow.org/api_docs/python/tf/variable_scope)\n",
    "- Build the inference decoder using [`tf.contrib.seq2seq.simple_decoder_fn_inference`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/simple_decoder_fn_inference) and [`tf.contrib.seq2seq.dynamic_rnn_decoder`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder).\n",
    " - The output function is applied to the output in this step "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "with tf.variable_scope(\"decoding\", reuse=True) as decoding_scope:\n",
    "    # Inference Decoder\n",
    "    infer_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_inference(\n",
    "        output_fn, enc_state, dec_embeddings, target_letter_to_int['<s>'], target_letter_to_int['<\\s>'], \n",
    "        sequence_length - 1, target_vocab_size)\n",
    "    inference_logits, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(dec_cell, infer_decoder_fn, scope=decoding_scope)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Optimization\n",
    "Our loss function is [`tf.contrib.seq2seq.sequence_loss`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/sequence_loss) provided by the tensor flow seq2seq module. It calculates a weighted cross-entropy loss for the output logits."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "# Loss function\n",
    "cost = tf.contrib.seq2seq.sequence_loss(\n",
    "    train_logits,\n",
    "    targets,\n",
    "    tf.ones([batch_size, sequence_length]))\n",
    "\n",
    "# Optimizer\n",
    "optimizer = tf.train.AdamOptimizer(lr)\n",
    "\n",
    "# Gradient Clipping\n",
    "gradients = optimizer.compute_gradients(cost)\n",
    "capped_gradients = [(tf.clip_by_value(grad, -1., 1.), var) for grad, var in gradients if grad is not None]\n",
    "train_op = optimizer.apply_gradients(capped_gradients)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": false
   },
   "source": [
    "## Train\n",
    "We're now ready to train our model. If you run into OOM (out of memory) issues during training, try to decrease the batch_size."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch   0 Batch    0/78 - Train Accuracy:  0.018, Validation Accuracy:  0.018, Loss:  3.415\n",
      "Epoch   0 Batch    1/78 - Train Accuracy:  0.374, Validation Accuracy:  0.398, Loss:  3.387\n",
      "Epoch   0 Batch    2/78 - Train Accuracy:  0.461, Validation Accuracy:  0.449, Loss:  3.356\n",
      "Epoch   0 Batch    3/78 - Train Accuracy:  0.450, Validation Accuracy:  0.449, Loss:  3.327\n",
      "Epoch   0 Batch    4/78 - Train Accuracy:  0.446, Validation Accuracy:  0.449, Loss:  3.297\n",
      "Epoch   0 Batch    5/78 - Train Accuracy:  0.445, Validation Accuracy:  0.449, Loss:  3.267\n",
      "Epoch   0 Batch    6/78 - Train Accuracy:  0.432, Validation Accuracy:  0.449, Loss:  3.238\n",
      "Epoch   0 Batch    7/78 - Train Accuracy:  0.432, Validation Accuracy:  0.449, Loss:  3.197\n",
      "Epoch   0 Batch    8/78 - Train Accuracy:  0.417, Validation Accuracy:  0.449, Loss:  3.165\n",
      "Epoch   0 Batch    9/78 - Train Accuracy:  0.451, Validation Accuracy:  0.449, Loss:  3.093\n",
      "Epoch   0 Batch   10/78 - Train Accuracy:  0.402, Validation Accuracy:  0.449, Loss:  3.078\n",
      "Epoch   0 Batch   11/78 - Train Accuracy:  0.392, Validation Accuracy:  0.449, Loss:  3.032\n",
      "Epoch   0 Batch   12/78 - Train Accuracy:  0.403, Validation Accuracy:  0.449, Loss:  2.969\n",
      "Epoch   0 Batch   13/78 - Train Accuracy:  0.406, Validation Accuracy:  0.449, Loss:  2.894\n",
      "Epoch   0 Batch   14/78 - Train Accuracy:  0.481, Validation Accuracy:  0.449, Loss:  2.722\n",
      "Epoch   0 Batch   15/78 - Train Accuracy:  0.402, Validation Accuracy:  0.449, Loss:  2.773\n",
      "Epoch   0 Batch   16/78 - Train Accuracy:  0.452, Validation Accuracy:  0.449, Loss:  2.598\n",
      "Epoch   0 Batch   17/78 - Train Accuracy:  0.464, Validation Accuracy:  0.449, Loss:  2.498\n",
      "Epoch   0 Batch   18/78 - Train Accuracy:  0.417, Validation Accuracy:  0.449, Loss:  2.539\n",
      "Epoch   0 Batch   19/78 - Train Accuracy:  0.445, Validation Accuracy:  0.449, Loss:  2.399\n",
      "Epoch   0 Batch   20/78 - Train Accuracy:  0.478, Validation Accuracy:  0.449, Loss:  2.247\n",
      "Epoch   0 Batch   21/78 - Train Accuracy:  0.398, Validation Accuracy:  0.449, Loss:  2.483\n",
      "Epoch   0 Batch   22/78 - Train Accuracy:  0.426, Validation Accuracy:  0.449, Loss:  2.397\n",
      "Epoch   0 Batch   23/78 - Train Accuracy:  0.472, Validation Accuracy:  0.449, Loss:  2.249\n",
      "Epoch   0 Batch   24/78 - Train Accuracy:  0.438, Validation Accuracy:  0.449, Loss:  2.387\n",
      "Epoch   0 Batch   25/78 - Train Accuracy:  0.424, Validation Accuracy:  0.449, Loss:  2.454\n",
      "Epoch   0 Batch   26/78 - Train Accuracy:  0.392, Validation Accuracy:  0.449, Loss:  2.586\n",
      "Epoch   0 Batch   27/78 - Train Accuracy:  0.414, Validation Accuracy:  0.449, Loss:  2.456\n",
      "Epoch   0 Batch   28/78 - Train Accuracy:  0.413, Validation Accuracy:  0.449, Loss:  2.461\n",
      "Epoch   0 Batch   29/78 - Train Accuracy:  0.451, Validation Accuracy:  0.449, Loss:  2.316\n",
      "Epoch   0 Batch   30/78 - Train Accuracy:  0.442, Validation Accuracy:  0.449, Loss:  2.324\n",
      "Epoch   0 Batch   31/78 - Train Accuracy:  0.461, Validation Accuracy:  0.449, Loss:  2.235\n",
      "Epoch   0 Batch   32/78 - Train Accuracy:  0.433, Validation Accuracy:  0.449, Loss:  2.330\n",
      "Epoch   0 Batch   33/78 - Train Accuracy:  0.404, Validation Accuracy:  0.449, Loss:  2.406\n",
      "Epoch   0 Batch   34/78 - Train Accuracy:  0.440, Validation Accuracy:  0.449, Loss:  2.265\n",
      "Epoch   0 Batch   35/78 - Train Accuracy:  0.430, Validation Accuracy:  0.449, Loss:  2.285\n",
      "Epoch   0 Batch   36/78 - Train Accuracy:  0.412, Validation Accuracy:  0.449, Loss:  2.337\n",
      "Epoch   0 Batch   37/78 - Train Accuracy:  0.420, Validation Accuracy:  0.449, Loss:  2.321\n",
      "Epoch   0 Batch   38/78 - Train Accuracy:  0.425, Validation Accuracy:  0.449, Loss:  2.269\n",
      "Epoch   0 Batch   39/78 - Train Accuracy:  0.402, Validation Accuracy:  0.449, Loss:  2.376\n",
      "Epoch   0 Batch   40/78 - Train Accuracy:  0.434, Validation Accuracy:  0.449, Loss:  2.254\n",
      "Epoch   0 Batch   41/78 - Train Accuracy:  0.393, Validation Accuracy:  0.449, Loss:  2.379\n",
      "Epoch   0 Batch   42/78 - Train Accuracy:  0.431, Validation Accuracy:  0.449, Loss:  2.255\n",
      "Epoch   0 Batch   43/78 - Train Accuracy:  0.384, Validation Accuracy:  0.449, Loss:  2.398\n",
      "Epoch   0 Batch   44/78 - Train Accuracy:  0.434, Validation Accuracy:  0.449, Loss:  2.226\n",
      "Epoch   0 Batch   45/78 - Train Accuracy:  0.424, Validation Accuracy:  0.450, Loss:  2.250\n",
      "Epoch   0 Batch   46/78 - Train Accuracy:  0.413, Validation Accuracy:  0.450, Loss:  2.276\n",
      "Epoch   0 Batch   47/78 - Train Accuracy:  0.468, Validation Accuracy:  0.451, Loss:  2.100\n",
      "Epoch   0 Batch   48/78 - Train Accuracy:  0.467, Validation Accuracy:  0.452, Loss:  2.086\n",
      "Epoch   0 Batch   49/78 - Train Accuracy:  0.408, Validation Accuracy:  0.453, Loss:  2.244\n",
      "Epoch   0 Batch   50/78 - Train Accuracy:  0.365, Validation Accuracy:  0.453, Loss:  2.385\n",
      "Epoch   0 Batch   51/78 - Train Accuracy:  0.434, Validation Accuracy:  0.453, Loss:  2.146\n",
      "Epoch   0 Batch   52/78 - Train Accuracy:  0.436, Validation Accuracy:  0.453, Loss:  2.142\n",
      "Epoch   0 Batch   53/78 - Train Accuracy:  0.430, Validation Accuracy:  0.453, Loss:  2.159\n",
      "Epoch   0 Batch   54/78 - Train Accuracy:  0.408, Validation Accuracy:  0.454, Loss:  2.221\n",
      "Epoch   0 Batch   55/78 - Train Accuracy:  0.403, Validation Accuracy:  0.455, Loss:  2.237\n",
      "Epoch   0 Batch   56/78 - Train Accuracy:  0.427, Validation Accuracy:  0.456, Loss:  2.145\n",
      "Epoch   0 Batch   57/78 - Train Accuracy:  0.401, Validation Accuracy:  0.458, Loss:  2.219\n",
      "Epoch   0 Batch   58/78 - Train Accuracy:  0.395, Validation Accuracy:  0.458, Loss:  2.245\n",
      "Epoch   0 Batch   59/78 - Train Accuracy:  0.411, Validation Accuracy:  0.459, Loss:  2.180\n",
      "Epoch   0 Batch   60/78 - Train Accuracy:  0.475, Validation Accuracy:  0.461, Loss:  1.952\n",
      "Epoch   0 Batch   61/78 - Train Accuracy:  0.423, Validation Accuracy:  0.462, Loss:  2.188\n",
      "Epoch   0 Batch   62/78 - Train Accuracy:  0.448, Validation Accuracy:  0.462, Loss:  2.085\n",
      "Epoch   0 Batch   63/78 - Train Accuracy:  0.465, Validation Accuracy:  0.462, Loss:  2.008\n",
      "Epoch   0 Batch   64/78 - Train Accuracy:  0.444, Validation Accuracy:  0.462, Loss:  2.034\n",
      "Epoch   0 Batch   65/78 - Train Accuracy:  0.454, Validation Accuracy:  0.462, Loss:  2.002\n",
      "Epoch   0 Batch   66/78 - Train Accuracy:  0.461, Validation Accuracy:  0.462, Loss:  2.006\n",
      "Epoch   0 Batch   67/78 - Train Accuracy:  0.465, Validation Accuracy:  0.462, Loss:  1.988\n",
      "Epoch   0 Batch   68/78 - Train Accuracy:  0.436, Validation Accuracy:  0.462, Loss:  2.077\n",
      "Epoch   0 Batch   69/78 - Train Accuracy:  0.499, Validation Accuracy:  0.462, Loss:  1.844\n",
      "Epoch   0 Batch   70/78 - Train Accuracy:  0.445, Validation Accuracy:  0.462, Loss:  2.044\n",
      "Epoch   0 Batch   71/78 - Train Accuracy:  0.463, Validation Accuracy:  0.463, Loss:  1.955\n",
      "Epoch   0 Batch   72/78 - Train Accuracy:  0.422, Validation Accuracy:  0.463, Loss:  2.098\n",
      "Epoch   0 Batch   73/78 - Train Accuracy:  0.392, Validation Accuracy:  0.463, Loss:  2.214\n",
      "Epoch   0 Batch   74/78 - Train Accuracy:  0.445, Validation Accuracy:  0.465, Loss:  1.988\n",
      "Epoch   0 Batch   75/78 - Train Accuracy:  0.444, Validation Accuracy:  0.465, Loss:  1.985\n",
      "Epoch   0 Batch   76/78 - Train Accuracy:  0.407, Validation Accuracy:  0.467, Loss:  2.099\n",
      "Epoch   1 Batch    0/78 - Train Accuracy:  0.427, Validation Accuracy:  0.467, Loss:  2.057\n",
      "Epoch   1 Batch    1/78 - Train Accuracy:  0.442, Validation Accuracy:  0.467, Loss:  2.003\n",
      "Epoch   1 Batch    2/78 - Train Accuracy:  0.474, Validation Accuracy:  0.467, Loss:  1.877\n",
      "Epoch   1 Batch    3/78 - Train Accuracy:  0.464, Validation Accuracy:  0.467, Loss:  1.901\n",
      "Epoch   1 Batch    4/78 - Train Accuracy:  0.472, Validation Accuracy:  0.467, Loss:  1.905\n",
      "Epoch   1 Batch    5/78 - Train Accuracy:  0.460, Validation Accuracy:  0.467, Loss:  1.899\n",
      "Epoch   1 Batch    6/78 - Train Accuracy:  0.458, Validation Accuracy:  0.467, Loss:  1.940\n",
      "Epoch   1 Batch    7/78 - Train Accuracy:  0.448, Validation Accuracy:  0.467, Loss:  1.938\n",
      "Epoch   1 Batch    8/78 - Train Accuracy:  0.432, Validation Accuracy:  0.468, Loss:  1.979\n",
      "Epoch   1 Batch    9/78 - Train Accuracy:  0.467, Validation Accuracy:  0.468, Loss:  1.870\n",
      "Epoch   1 Batch   10/78 - Train Accuracy:  0.432, Validation Accuracy:  0.468, Loss:  2.013\n",
      "Epoch   1 Batch   11/78 - Train Accuracy:  0.417, Validation Accuracy:  0.468, Loss:  2.032\n",
      "Epoch   1 Batch   12/78 - Train Accuracy:  0.433, Validation Accuracy:  0.468, Loss:  2.002\n",
      "Epoch   1 Batch   13/78 - Train Accuracy:  0.435, Validation Accuracy:  0.469, Loss:  1.979\n",
      "Epoch   1 Batch   14/78 - Train Accuracy:  0.497, Validation Accuracy:  0.468, Loss:  1.748\n",
      "Epoch   1 Batch   15/78 - Train Accuracy:  0.420, Validation Accuracy:  0.469, Loss:  1.990\n",
      "Epoch   1 Batch   16/78 - Train Accuracy:  0.465, Validation Accuracy:  0.468, Loss:  1.826\n",
      "Epoch   1 Batch   17/78 - Train Accuracy:  0.483, Validation Accuracy:  0.468, Loss:  1.782\n",
      "Epoch   1 Batch   18/78 - Train Accuracy:  0.441, Validation Accuracy:  0.468, Loss:  1.905\n",
      "Epoch   1 Batch   19/78 - Train Accuracy:  0.470, Validation Accuracy:  0.468, Loss:  1.824\n",
      "Epoch   1 Batch   20/78 - Train Accuracy:  0.496, Validation Accuracy:  0.469, Loss:  1.718\n",
      "Epoch   1 Batch   21/78 - Train Accuracy:  0.426, Validation Accuracy:  0.470, Loss:  1.948\n",
      "Epoch   1 Batch   22/78 - Train Accuracy:  0.442, Validation Accuracy:  0.473, Loss:  1.853\n",
      "Epoch   1 Batch   23/78 - Train Accuracy:  0.497, Validation Accuracy:  0.472, Loss:  1.717\n",
      "Epoch   1 Batch   24/78 - Train Accuracy:  0.462, Validation Accuracy:  0.472, Loss:  1.809\n",
      "Epoch   1 Batch   25/78 - Train Accuracy:  0.450, Validation Accuracy:  0.475, Loss:  1.855\n",
      "Epoch   1 Batch   26/78 - Train Accuracy:  0.434, Validation Accuracy:  0.481, Loss:  1.920\n",
      "Epoch   1 Batch   27/78 - Train Accuracy:  0.442, Validation Accuracy:  0.482, Loss:  1.876\n",
      "Epoch   1 Batch   28/78 - Train Accuracy:  0.446, Validation Accuracy:  0.484, Loss:  1.861\n",
      "Epoch   1 Batch   29/78 - Train Accuracy:  0.484, Validation Accuracy:  0.488, Loss:  1.736\n",
      "Epoch   1 Batch   30/78 - Train Accuracy:  0.475, Validation Accuracy:  0.487, Loss:  1.761\n",
      "Epoch   1 Batch   31/78 - Train Accuracy:  0.489, Validation Accuracy:  0.489, Loss:  1.693\n",
      "Epoch   1 Batch   32/78 - Train Accuracy:  0.467, Validation Accuracy:  0.488, Loss:  1.783\n",
      "Epoch   1 Batch   33/78 - Train Accuracy:  0.444, Validation Accuracy:  0.489, Loss:  1.845\n",
      "Epoch   1 Batch   34/78 - Train Accuracy:  0.475, Validation Accuracy:  0.492, Loss:  1.746\n",
      "Epoch   1 Batch   35/78 - Train Accuracy:  0.479, Validation Accuracy:  0.490, Loss:  1.761\n",
      "Epoch   1 Batch   36/78 - Train Accuracy:  0.465, Validation Accuracy:  0.490, Loss:  1.795\n",
      "Epoch   1 Batch   37/78 - Train Accuracy:  0.470, Validation Accuracy:  0.488, Loss:  1.785\n",
      "Epoch   1 Batch   38/78 - Train Accuracy:  0.460, Validation Accuracy:  0.487, Loss:  1.761\n",
      "Epoch   1 Batch   39/78 - Train Accuracy:  0.444, Validation Accuracy:  0.488, Loss:  1.827\n",
      "Epoch   1 Batch   40/78 - Train Accuracy:  0.475, Validation Accuracy:  0.485, Loss:  1.720\n",
      "Epoch   1 Batch   41/78 - Train Accuracy:  0.445, Validation Accuracy:  0.485, Loss:  1.833\n",
      "Epoch   1 Batch   42/78 - Train Accuracy:  0.490, Validation Accuracy:  0.483, Loss:  1.704\n",
      "Epoch   1 Batch   43/78 - Train Accuracy:  0.433, Validation Accuracy:  0.485, Loss:  1.832\n",
      "Epoch   1 Batch   44/78 - Train Accuracy:  0.488, Validation Accuracy:  0.488, Loss:  1.689\n",
      "Epoch   1 Batch   45/78 - Train Accuracy:  0.478, Validation Accuracy:  0.490, Loss:  1.692\n",
      "Epoch   1 Batch   46/78 - Train Accuracy:  0.456, Validation Accuracy:  0.489, Loss:  1.751\n",
      "Epoch   1 Batch   47/78 - Train Accuracy:  0.515, Validation Accuracy:  0.489, Loss:  1.585\n",
      "Epoch   1 Batch   48/78 - Train Accuracy:  0.502, Validation Accuracy:  0.489, Loss:  1.593\n",
      "Epoch   1 Batch   49/78 - Train Accuracy:  0.451, Validation Accuracy:  0.488, Loss:  1.736\n",
      "Epoch   1 Batch   50/78 - Train Accuracy:  0.423, Validation Accuracy:  0.490, Loss:  1.837\n",
      "Epoch   1 Batch   51/78 - Train Accuracy:  0.477, Validation Accuracy:  0.492, Loss:  1.646\n",
      "Epoch   1 Batch   52/78 - Train Accuracy:  0.485, Validation Accuracy:  0.497, Loss:  1.644\n",
      "Epoch   1 Batch   53/78 - Train Accuracy:  0.483, Validation Accuracy:  0.494, Loss:  1.660\n",
      "Epoch   1 Batch   54/78 - Train Accuracy:  0.458, Validation Accuracy:  0.498, Loss:  1.724\n",
      "Epoch   1 Batch   55/78 - Train Accuracy:  0.449, Validation Accuracy:  0.499, Loss:  1.738\n",
      "Epoch   1 Batch   56/78 - Train Accuracy:  0.474, Validation Accuracy:  0.499, Loss:  1.668\n",
      "Epoch   1 Batch   57/78 - Train Accuracy:  0.453, Validation Accuracy:  0.499, Loss:  1.725\n",
      "Epoch   1 Batch   58/78 - Train Accuracy:  0.452, Validation Accuracy:  0.504, Loss:  1.762\n",
      "Epoch   1 Batch   59/78 - Train Accuracy:  0.463, Validation Accuracy:  0.507, Loss:  1.713\n",
      "Epoch   1 Batch   60/78 - Train Accuracy:  0.522, Validation Accuracy:  0.509, Loss:  1.532\n",
      "Epoch   1 Batch   61/78 - Train Accuracy:  0.453, Validation Accuracy:  0.510, Loss:  1.717\n",
      "Epoch   1 Batch   62/78 - Train Accuracy:  0.481, Validation Accuracy:  0.510, Loss:  1.632\n",
      "Epoch   1 Batch   63/78 - Train Accuracy:  0.509, Validation Accuracy:  0.513, Loss:  1.550\n",
      "Epoch   1 Batch   64/78 - Train Accuracy:  0.497, Validation Accuracy:  0.512, Loss:  1.565\n",
      "Epoch   1 Batch   65/78 - Train Accuracy:  0.502, Validation Accuracy:  0.521, Loss:  1.561\n",
      "Epoch   1 Batch   66/78 - Train Accuracy:  0.519, Validation Accuracy:  0.523, Loss:  1.551\n",
      "Epoch   1 Batch   67/78 - Train Accuracy:  0.520, Validation Accuracy:  0.523, Loss:  1.523\n",
      "Epoch   1 Batch   68/78 - Train Accuracy:  0.497, Validation Accuracy:  0.526, Loss:  1.611\n",
      "Epoch   1 Batch   69/78 - Train Accuracy:  0.565, Validation Accuracy:  0.529, Loss:  1.415\n",
      "Epoch   1 Batch   70/78 - Train Accuracy:  0.498, Validation Accuracy:  0.530, Loss:  1.578\n",
      "Epoch   1 Batch   71/78 - Train Accuracy:  0.537, Validation Accuracy:  0.526, Loss:  1.494\n",
      "Epoch   1 Batch   72/78 - Train Accuracy:  0.478, Validation Accuracy:  0.520, Loss:  1.617\n",
      "Epoch   1 Batch   73/78 - Train Accuracy:  0.465, Validation Accuracy:  0.518, Loss:  1.697\n",
      "Epoch   1 Batch   74/78 - Train Accuracy:  0.512, Validation Accuracy:  0.521, Loss:  1.537\n",
      "Epoch   1 Batch   75/78 - Train Accuracy:  0.512, Validation Accuracy:  0.523, Loss:  1.530\n",
      "Epoch   1 Batch   76/78 - Train Accuracy:  0.497, Validation Accuracy:  0.527, Loss:  1.581\n",
      "Epoch   2 Batch    0/78 - Train Accuracy:  0.516, Validation Accuracy:  0.529, Loss:  1.571\n",
      "Epoch   2 Batch    1/78 - Train Accuracy:  0.521, Validation Accuracy:  0.531, Loss:  1.520\n",
      "Epoch   2 Batch    2/78 - Train Accuracy:  0.552, Validation Accuracy:  0.530, Loss:  1.422\n",
      "Epoch   2 Batch    3/78 - Train Accuracy:  0.549, Validation Accuracy:  0.537, Loss:  1.438\n",
      "Epoch   2 Batch    4/78 - Train Accuracy:  0.546, Validation Accuracy:  0.539, Loss:  1.442\n",
      "Epoch   2 Batch    5/78 - Train Accuracy:  0.550, Validation Accuracy:  0.536, Loss:  1.434\n",
      "Epoch   2 Batch    6/78 - Train Accuracy:  0.547, Validation Accuracy:  0.539, Loss:  1.454\n",
      "Epoch   2 Batch    7/78 - Train Accuracy:  0.547, Validation Accuracy:  0.548, Loss:  1.445\n",
      "Epoch   2 Batch    8/78 - Train Accuracy:  0.530, Validation Accuracy:  0.542, Loss:  1.487\n",
      "Epoch   2 Batch    9/78 - Train Accuracy:  0.554, Validation Accuracy:  0.546, Loss:  1.390\n",
      "Epoch   2 Batch   10/78 - Train Accuracy:  0.533, Validation Accuracy:  0.540, Loss:  1.491\n",
      "Epoch   2 Batch   11/78 - Train Accuracy:  0.525, Validation Accuracy:  0.549, Loss:  1.534\n",
      "Epoch   2 Batch   12/78 - Train Accuracy:  0.517, Validation Accuracy:  0.554, Loss:  1.494\n",
      "Epoch   2 Batch   13/78 - Train Accuracy:  0.527, Validation Accuracy:  0.556, Loss:  1.479\n",
      "Epoch   2 Batch   14/78 - Train Accuracy:  0.594, Validation Accuracy:  0.551, Loss:  1.294\n",
      "Epoch   2 Batch   15/78 - Train Accuracy:  0.529, Validation Accuracy:  0.552, Loss:  1.479\n",
      "Epoch   2 Batch   16/78 - Train Accuracy:  0.565, Validation Accuracy:  0.557, Loss:  1.379\n",
      "Epoch   2 Batch   17/78 - Train Accuracy:  0.574, Validation Accuracy:  0.561, Loss:  1.334\n",
      "Epoch   2 Batch   18/78 - Train Accuracy:  0.560, Validation Accuracy:  0.555, Loss:  1.414\n",
      "Epoch   2 Batch   19/78 - Train Accuracy:  0.576, Validation Accuracy:  0.556, Loss:  1.343\n",
      "Epoch   2 Batch   20/78 - Train Accuracy:  0.597, Validation Accuracy:  0.565, Loss:  1.300\n",
      "Epoch   2 Batch   21/78 - Train Accuracy:  0.539, Validation Accuracy:  0.561, Loss:  1.453\n",
      "Epoch   2 Batch   22/78 - Train Accuracy:  0.536, Validation Accuracy:  0.558, Loss:  1.395\n",
      "Epoch   2 Batch   23/78 - Train Accuracy:  0.584, Validation Accuracy:  0.561, Loss:  1.280\n",
      "Epoch   2 Batch   24/78 - Train Accuracy:  0.565, Validation Accuracy:  0.565, Loss:  1.345\n",
      "Epoch   2 Batch   25/78 - Train Accuracy:  0.567, Validation Accuracy:  0.561, Loss:  1.383\n",
      "Epoch   2 Batch   26/78 - Train Accuracy:  0.533, Validation Accuracy:  0.560, Loss:  1.454\n",
      "Epoch   2 Batch   27/78 - Train Accuracy:  0.566, Validation Accuracy:  0.579, Loss:  1.386\n",
      "Epoch   2 Batch   28/78 - Train Accuracy:  0.557, Validation Accuracy:  0.580, Loss:  1.401\n",
      "Epoch   2 Batch   29/78 - Train Accuracy:  0.584, Validation Accuracy:  0.576, Loss:  1.317\n",
      "Epoch   2 Batch   30/78 - Train Accuracy:  0.568, Validation Accuracy:  0.573, Loss:  1.328\n",
      "Epoch   2 Batch   31/78 - Train Accuracy:  0.603, Validation Accuracy:  0.584, Loss:  1.266\n",
      "Epoch   2 Batch   32/78 - Train Accuracy:  0.575, Validation Accuracy:  0.578, Loss:  1.329\n",
      "Epoch   2 Batch   33/78 - Train Accuracy:  0.542, Validation Accuracy:  0.571, Loss:  1.399\n",
      "Epoch   2 Batch   34/78 - Train Accuracy:  0.575, Validation Accuracy:  0.577, Loss:  1.312\n",
      "Epoch   2 Batch   35/78 - Train Accuracy:  0.597, Validation Accuracy:  0.585, Loss:  1.340\n",
      "Epoch   2 Batch   36/78 - Train Accuracy:  0.573, Validation Accuracy:  0.585, Loss:  1.366\n",
      "Epoch   2 Batch   37/78 - Train Accuracy:  0.569, Validation Accuracy:  0.584, Loss:  1.361\n",
      "Epoch   2 Batch   38/78 - Train Accuracy:  0.573, Validation Accuracy:  0.587, Loss:  1.336\n",
      "Epoch   2 Batch   39/78 - Train Accuracy:  0.576, Validation Accuracy:  0.595, Loss:  1.379\n",
      "Epoch   2 Batch   40/78 - Train Accuracy:  0.597, Validation Accuracy:  0.583, Loss:  1.316\n",
      "Epoch   2 Batch   41/78 - Train Accuracy:  0.544, Validation Accuracy:  0.580, Loss:  1.382\n",
      "Epoch   2 Batch   42/78 - Train Accuracy:  0.584, Validation Accuracy:  0.587, Loss:  1.302\n",
      "Epoch   2 Batch   43/78 - Train Accuracy:  0.547, Validation Accuracy:  0.598, Loss:  1.396\n",
      "Epoch   2 Batch   44/78 - Train Accuracy:  0.596, Validation Accuracy:  0.590, Loss:  1.284\n",
      "Epoch   2 Batch   45/78 - Train Accuracy:  0.604, Validation Accuracy:  0.592, Loss:  1.282\n",
      "Epoch   2 Batch   46/78 - Train Accuracy:  0.581, Validation Accuracy:  0.602, Loss:  1.365\n",
      "Epoch   2 Batch   47/78 - Train Accuracy:  0.632, Validation Accuracy:  0.603, Loss:  1.205\n",
      "Epoch   2 Batch   48/78 - Train Accuracy:  0.629, Validation Accuracy:  0.606, Loss:  1.212\n",
      "Epoch   2 Batch   49/78 - Train Accuracy:  0.573, Validation Accuracy:  0.604, Loss:  1.359\n",
      "Epoch   2 Batch   50/78 - Train Accuracy:  0.558, Validation Accuracy:  0.604, Loss:  1.421\n",
      "Epoch   2 Batch   51/78 - Train Accuracy:  0.604, Validation Accuracy:  0.606, Loss:  1.268\n",
      "Epoch   2 Batch   52/78 - Train Accuracy:  0.612, Validation Accuracy:  0.623, Loss:  1.265\n",
      "Epoch   2 Batch   53/78 - Train Accuracy:  0.597, Validation Accuracy:  0.621, Loss:  1.273\n",
      "Epoch   2 Batch   54/78 - Train Accuracy:  0.603, Validation Accuracy:  0.606, Loss:  1.308\n",
      "Epoch   2 Batch   55/78 - Train Accuracy:  0.574, Validation Accuracy:  0.615, Loss:  1.337\n",
      "Epoch   2 Batch   56/78 - Train Accuracy:  0.599, Validation Accuracy:  0.627, Loss:  1.280\n",
      "Epoch   2 Batch   57/78 - Train Accuracy:  0.571, Validation Accuracy:  0.613, Loss:  1.330\n",
      "Epoch   2 Batch   58/78 - Train Accuracy:  0.586, Validation Accuracy:  0.622, Loss:  1.353\n",
      "Epoch   2 Batch   59/78 - Train Accuracy:  0.570, Validation Accuracy:  0.631, Loss:  1.326\n",
      "Epoch   2 Batch   60/78 - Train Accuracy:  0.642, Validation Accuracy:  0.635, Loss:  1.167\n",
      "Epoch   2 Batch   61/78 - Train Accuracy:  0.566, Validation Accuracy:  0.622, Loss:  1.335\n",
      "Epoch   2 Batch   62/78 - Train Accuracy:  0.586, Validation Accuracy:  0.629, Loss:  1.253\n",
      "Epoch   2 Batch   63/78 - Train Accuracy:  0.637, Validation Accuracy:  0.632, Loss:  1.179\n",
      "Epoch   2 Batch   64/78 - Train Accuracy:  0.617, Validation Accuracy:  0.634, Loss:  1.207\n",
      "Epoch   2 Batch   65/78 - Train Accuracy:  0.606, Validation Accuracy:  0.616, Loss:  1.204\n",
      "Epoch   2 Batch   66/78 - Train Accuracy:  0.633, Validation Accuracy:  0.615, Loss:  1.165\n",
      "Epoch   2 Batch   67/78 - Train Accuracy:  0.623, Validation Accuracy:  0.632, Loss:  1.176\n",
      "Epoch   2 Batch   68/78 - Train Accuracy:  0.608, Validation Accuracy:  0.632, Loss:  1.261\n",
      "Epoch   2 Batch   69/78 - Train Accuracy:  0.666, Validation Accuracy:  0.627, Loss:  1.084\n",
      "Epoch   2 Batch   70/78 - Train Accuracy:  0.613, Validation Accuracy:  0.631, Loss:  1.232\n",
      "Epoch   2 Batch   71/78 - Train Accuracy:  0.650, Validation Accuracy:  0.642, Loss:  1.156\n",
      "Epoch   2 Batch   72/78 - Train Accuracy:  0.597, Validation Accuracy:  0.641, Loss:  1.266\n",
      "Epoch   2 Batch   73/78 - Train Accuracy:  0.565, Validation Accuracy:  0.636, Loss:  1.344\n",
      "Epoch   2 Batch   74/78 - Train Accuracy:  0.622, Validation Accuracy:  0.629, Loss:  1.192\n",
      "Epoch   2 Batch   75/78 - Train Accuracy:  0.612, Validation Accuracy:  0.645, Loss:  1.206\n",
      "Epoch   2 Batch   76/78 - Train Accuracy:  0.602, Validation Accuracy:  0.645, Loss:  1.243\n",
      "Epoch   3 Batch    0/78 - Train Accuracy:  0.622, Validation Accuracy:  0.640, Loss:  1.234\n",
      "Epoch   3 Batch    1/78 - Train Accuracy:  0.638, Validation Accuracy:  0.645, Loss:  1.189\n",
      "Epoch   3 Batch    2/78 - Train Accuracy:  0.655, Validation Accuracy:  0.652, Loss:  1.099\n",
      "Epoch   3 Batch    3/78 - Train Accuracy:  0.656, Validation Accuracy:  0.653, Loss:  1.131\n",
      "Epoch   3 Batch    4/78 - Train Accuracy:  0.642, Validation Accuracy:  0.647, Loss:  1.137\n",
      "Epoch   3 Batch    5/78 - Train Accuracy:  0.643, Validation Accuracy:  0.643, Loss:  1.143\n",
      "Epoch   3 Batch    6/78 - Train Accuracy:  0.656, Validation Accuracy:  0.650, Loss:  1.148\n",
      "Epoch   3 Batch    7/78 - Train Accuracy:  0.654, Validation Accuracy:  0.651, Loss:  1.134\n",
      "Epoch   3 Batch    8/78 - Train Accuracy:  0.617, Validation Accuracy:  0.655, Loss:  1.190\n",
      "Epoch   3 Batch    9/78 - Train Accuracy:  0.676, Validation Accuracy:  0.657, Loss:  1.081\n",
      "Epoch   3 Batch   10/78 - Train Accuracy:  0.654, Validation Accuracy:  0.658, Loss:  1.163\n",
      "Epoch   3 Batch   11/78 - Train Accuracy:  0.622, Validation Accuracy:  0.660, Loss:  1.222\n",
      "Epoch   3 Batch   12/78 - Train Accuracy:  0.638, Validation Accuracy:  0.654, Loss:  1.180\n",
      "Epoch   3 Batch   13/78 - Train Accuracy:  0.638, Validation Accuracy:  0.660, Loss:  1.174\n",
      "Epoch   3 Batch   14/78 - Train Accuracy:  0.681, Validation Accuracy:  0.665, Loss:  1.019\n",
      "Epoch   3 Batch   15/78 - Train Accuracy:  0.627, Validation Accuracy:  0.655, Loss:  1.181\n",
      "Epoch   3 Batch   16/78 - Train Accuracy:  0.674, Validation Accuracy:  0.667, Loss:  1.069\n",
      "Epoch   3 Batch   17/78 - Train Accuracy:  0.679, Validation Accuracy:  0.664, Loss:  1.047\n",
      "Epoch   3 Batch   18/78 - Train Accuracy:  0.641, Validation Accuracy:  0.662, Loss:  1.145\n",
      "Epoch   3 Batch   19/78 - Train Accuracy:  0.681, Validation Accuracy:  0.652, Loss:  1.059\n",
      "Epoch   3 Batch   20/78 - Train Accuracy:  0.689, Validation Accuracy:  0.661, Loss:  1.028\n",
      "Epoch   3 Batch   21/78 - Train Accuracy:  0.628, Validation Accuracy:  0.665, Loss:  1.166\n",
      "Epoch   3 Batch   22/78 - Train Accuracy:  0.642, Validation Accuracy:  0.662, Loss:  1.132\n",
      "Epoch   3 Batch   23/78 - Train Accuracy:  0.688, Validation Accuracy:  0.661, Loss:  0.999\n",
      "Epoch   3 Batch   24/78 - Train Accuracy:  0.669, Validation Accuracy:  0.674, Loss:  1.077\n",
      "Epoch   3 Batch   25/78 - Train Accuracy:  0.655, Validation Accuracy:  0.675, Loss:  1.096\n",
      "Epoch   3 Batch   26/78 - Train Accuracy:  0.646, Validation Accuracy:  0.670, Loss:  1.164\n",
      "Epoch   3 Batch   27/78 - Train Accuracy:  0.664, Validation Accuracy:  0.670, Loss:  1.106\n",
      "Epoch   3 Batch   28/78 - Train Accuracy:  0.666, Validation Accuracy:  0.673, Loss:  1.121\n",
      "Epoch   3 Batch   29/78 - Train Accuracy:  0.674, Validation Accuracy:  0.677, Loss:  1.048\n",
      "Epoch   3 Batch   30/78 - Train Accuracy:  0.670, Validation Accuracy:  0.675, Loss:  1.058\n",
      "Epoch   3 Batch   31/78 - Train Accuracy:  0.684, Validation Accuracy:  0.674, Loss:  1.003\n",
      "Epoch   3 Batch   32/78 - Train Accuracy:  0.673, Validation Accuracy:  0.679, Loss:  1.040\n",
      "Epoch   3 Batch   33/78 - Train Accuracy:  0.661, Validation Accuracy:  0.682, Loss:  1.117\n",
      "Epoch   3 Batch   34/78 - Train Accuracy:  0.665, Validation Accuracy:  0.683, Loss:  1.054\n",
      "Epoch   3 Batch   35/78 - Train Accuracy:  0.674, Validation Accuracy:  0.686, Loss:  1.062\n",
      "Epoch   3 Batch   36/78 - Train Accuracy:  0.657, Validation Accuracy:  0.682, Loss:  1.100\n",
      "Epoch   3 Batch   37/78 - Train Accuracy:  0.658, Validation Accuracy:  0.680, Loss:  1.090\n",
      "Epoch   3 Batch   38/78 - Train Accuracy:  0.654, Validation Accuracy:  0.681, Loss:  1.070\n",
      "Epoch   3 Batch   39/78 - Train Accuracy:  0.650, Validation Accuracy:  0.682, Loss:  1.099\n",
      "Epoch   3 Batch   40/78 - Train Accuracy:  0.679, Validation Accuracy:  0.679, Loss:  1.042\n",
      "Epoch   3 Batch   41/78 - Train Accuracy:  0.637, Validation Accuracy:  0.682, Loss:  1.123\n",
      "Epoch   3 Batch   42/78 - Train Accuracy:  0.665, Validation Accuracy:  0.679, Loss:  1.041\n",
      "Epoch   3 Batch   43/78 - Train Accuracy:  0.648, Validation Accuracy:  0.681, Loss:  1.127\n",
      "Epoch   3 Batch   44/78 - Train Accuracy:  0.680, Validation Accuracy:  0.683, Loss:  1.025\n",
      "Epoch   3 Batch   45/78 - Train Accuracy:  0.682, Validation Accuracy:  0.683, Loss:  1.028\n",
      "Epoch   3 Batch   46/78 - Train Accuracy:  0.644, Validation Accuracy:  0.689, Loss:  1.105\n",
      "Epoch   3 Batch   47/78 - Train Accuracy:  0.696, Validation Accuracy:  0.682, Loss:  0.960\n",
      "Epoch   3 Batch   48/78 - Train Accuracy:  0.695, Validation Accuracy:  0.685, Loss:  0.960\n",
      "Epoch   3 Batch   49/78 - Train Accuracy:  0.669, Validation Accuracy:  0.686, Loss:  1.081\n",
      "Epoch   3 Batch   50/78 - Train Accuracy:  0.650, Validation Accuracy:  0.696, Loss:  1.163\n",
      "Epoch   3 Batch   51/78 - Train Accuracy:  0.676, Validation Accuracy:  0.691, Loss:  1.018\n",
      "Epoch   3 Batch   52/78 - Train Accuracy:  0.686, Validation Accuracy:  0.694, Loss:  1.009\n",
      "Epoch   3 Batch   53/78 - Train Accuracy:  0.679, Validation Accuracy:  0.693, Loss:  1.011\n",
      "Epoch   3 Batch   54/78 - Train Accuracy:  0.688, Validation Accuracy:  0.691, Loss:  1.046\n",
      "Epoch   3 Batch   55/78 - Train Accuracy:  0.664, Validation Accuracy:  0.690, Loss:  1.070\n",
      "Epoch   3 Batch   56/78 - Train Accuracy:  0.688, Validation Accuracy:  0.698, Loss:  1.020\n",
      "Epoch   3 Batch   57/78 - Train Accuracy:  0.671, Validation Accuracy:  0.703, Loss:  1.072\n",
      "Epoch   3 Batch   58/78 - Train Accuracy:  0.673, Validation Accuracy:  0.704, Loss:  1.085\n",
      "Epoch   3 Batch   59/78 - Train Accuracy:  0.632, Validation Accuracy:  0.705, Loss:  1.072\n",
      "Epoch   3 Batch   60/78 - Train Accuracy:  0.722, Validation Accuracy:  0.711, Loss:  0.917\n",
      "Epoch   3 Batch   61/78 - Train Accuracy:  0.661, Validation Accuracy:  0.709, Loss:  1.065\n",
      "Epoch   3 Batch   62/78 - Train Accuracy:  0.680, Validation Accuracy:  0.704, Loss:  1.002\n",
      "Epoch   3 Batch   63/78 - Train Accuracy:  0.709, Validation Accuracy:  0.708, Loss:  0.944\n",
      "Epoch   3 Batch   64/78 - Train Accuracy:  0.696, Validation Accuracy:  0.711, Loss:  0.973\n",
      "Epoch   3 Batch   65/78 - Train Accuracy:  0.702, Validation Accuracy:  0.706, Loss:  0.958\n",
      "Epoch   3 Batch   66/78 - Train Accuracy:  0.734, Validation Accuracy:  0.709, Loss:  0.906\n",
      "Epoch   3 Batch   67/78 - Train Accuracy:  0.704, Validation Accuracy:  0.718, Loss:  0.936\n",
      "Epoch   3 Batch   68/78 - Train Accuracy:  0.694, Validation Accuracy:  0.721, Loss:  1.005\n",
      "Epoch   3 Batch   69/78 - Train Accuracy:  0.734, Validation Accuracy:  0.717, Loss:  0.859\n",
      "Epoch   3 Batch   70/78 - Train Accuracy:  0.686, Validation Accuracy:  0.711, Loss:  0.989\n",
      "Epoch   3 Batch   71/78 - Train Accuracy:  0.723, Validation Accuracy:  0.718, Loss:  0.928\n",
      "Epoch   3 Batch   72/78 - Train Accuracy:  0.690, Validation Accuracy:  0.725, Loss:  1.006\n",
      "Epoch   3 Batch   73/78 - Train Accuracy:  0.642, Validation Accuracy:  0.708, Loss:  1.106\n",
      "Epoch   3 Batch   74/78 - Train Accuracy:  0.692, Validation Accuracy:  0.715, Loss:  0.970\n",
      "Epoch   3 Batch   75/78 - Train Accuracy:  0.720, Validation Accuracy:  0.725, Loss:  0.979\n",
      "Epoch   3 Batch   76/78 - Train Accuracy:  0.703, Validation Accuracy:  0.728, Loss:  1.006\n",
      "Epoch   4 Batch    0/78 - Train Accuracy:  0.680, Validation Accuracy:  0.713, Loss:  1.002\n",
      "Epoch   4 Batch    1/78 - Train Accuracy:  0.711, Validation Accuracy:  0.712, Loss:  0.946\n",
      "Epoch   4 Batch    2/78 - Train Accuracy:  0.729, Validation Accuracy:  0.725, Loss:  0.879\n",
      "Epoch   4 Batch    3/78 - Train Accuracy:  0.734, Validation Accuracy:  0.722, Loss:  0.910\n",
      "Epoch   4 Batch    4/78 - Train Accuracy:  0.708, Validation Accuracy:  0.724, Loss:  0.918\n",
      "Epoch   4 Batch    5/78 - Train Accuracy:  0.708, Validation Accuracy:  0.723, Loss:  0.920\n",
      "Epoch   4 Batch    6/78 - Train Accuracy:  0.729, Validation Accuracy:  0.738, Loss:  0.934\n",
      "Epoch   4 Batch    7/78 - Train Accuracy:  0.725, Validation Accuracy:  0.738, Loss:  0.915\n",
      "Epoch   4 Batch    8/78 - Train Accuracy:  0.709, Validation Accuracy:  0.737, Loss:  0.957\n",
      "Epoch   4 Batch    9/78 - Train Accuracy:  0.737, Validation Accuracy:  0.733, Loss:  0.856\n",
      "Epoch   4 Batch   10/78 - Train Accuracy:  0.715, Validation Accuracy:  0.734, Loss:  0.944\n",
      "Epoch   4 Batch   11/78 - Train Accuracy:  0.695, Validation Accuracy:  0.741, Loss:  0.984\n",
      "Epoch   4 Batch   12/78 - Train Accuracy:  0.708, Validation Accuracy:  0.739, Loss:  0.960\n",
      "Epoch   4 Batch   13/78 - Train Accuracy:  0.702, Validation Accuracy:  0.731, Loss:  0.955\n",
      "Epoch   4 Batch   14/78 - Train Accuracy:  0.754, Validation Accuracy:  0.737, Loss:  0.817\n",
      "Epoch   4 Batch   15/78 - Train Accuracy:  0.709, Validation Accuracy:  0.739, Loss:  0.953\n",
      "Epoch   4 Batch   16/78 - Train Accuracy:  0.744, Validation Accuracy:  0.734, Loss:  0.852\n",
      "Epoch   4 Batch   17/78 - Train Accuracy:  0.741, Validation Accuracy:  0.737, Loss:  0.853\n",
      "Epoch   4 Batch   18/78 - Train Accuracy:  0.720, Validation Accuracy:  0.735, Loss:  0.928\n",
      "Epoch   4 Batch   19/78 - Train Accuracy:  0.749, Validation Accuracy:  0.737, Loss:  0.856\n",
      "Epoch   4 Batch   20/78 - Train Accuracy:  0.759, Validation Accuracy:  0.742, Loss:  0.811\n",
      "Epoch   4 Batch   21/78 - Train Accuracy:  0.709, Validation Accuracy:  0.743, Loss:  0.955\n",
      "Epoch   4 Batch   22/78 - Train Accuracy:  0.703, Validation Accuracy:  0.735, Loss:  0.914\n",
      "Epoch   4 Batch   23/78 - Train Accuracy:  0.783, Validation Accuracy:  0.733, Loss:  0.796\n",
      "Epoch   4 Batch   24/78 - Train Accuracy:  0.748, Validation Accuracy:  0.740, Loss:  0.862\n",
      "Epoch   4 Batch   25/78 - Train Accuracy:  0.720, Validation Accuracy:  0.740, Loss:  0.889\n",
      "Epoch   4 Batch   26/78 - Train Accuracy:  0.723, Validation Accuracy:  0.737, Loss:  0.937\n",
      "Epoch   4 Batch   27/78 - Train Accuracy:  0.738, Validation Accuracy:  0.749, Loss:  0.889\n",
      "Epoch   4 Batch   28/78 - Train Accuracy:  0.720, Validation Accuracy:  0.748, Loss:  0.906\n",
      "Epoch   4 Batch   29/78 - Train Accuracy:  0.735, Validation Accuracy:  0.746, Loss:  0.832\n",
      "Epoch   4 Batch   30/78 - Train Accuracy:  0.737, Validation Accuracy:  0.741, Loss:  0.856\n",
      "Epoch   4 Batch   31/78 - Train Accuracy:  0.753, Validation Accuracy:  0.742, Loss:  0.799\n",
      "Epoch   4 Batch   32/78 - Train Accuracy:  0.739, Validation Accuracy:  0.740, Loss:  0.835\n",
      "Epoch   4 Batch   33/78 - Train Accuracy:  0.740, Validation Accuracy:  0.743, Loss:  0.884\n",
      "Epoch   4 Batch   34/78 - Train Accuracy:  0.738, Validation Accuracy:  0.744, Loss:  0.853\n",
      "Epoch   4 Batch   35/78 - Train Accuracy:  0.742, Validation Accuracy:  0.747, Loss:  0.853\n",
      "Epoch   4 Batch   36/78 - Train Accuracy:  0.729, Validation Accuracy:  0.747, Loss:  0.886\n",
      "Epoch   4 Batch   37/78 - Train Accuracy:  0.720, Validation Accuracy:  0.748, Loss:  0.890\n",
      "Epoch   4 Batch   38/78 - Train Accuracy:  0.744, Validation Accuracy:  0.746, Loss:  0.847\n",
      "Epoch   4 Batch   39/78 - Train Accuracy:  0.728, Validation Accuracy:  0.748, Loss:  0.895\n",
      "Epoch   4 Batch   40/78 - Train Accuracy:  0.752, Validation Accuracy:  0.754, Loss:  0.834\n",
      "Epoch   4 Batch   41/78 - Train Accuracy:  0.718, Validation Accuracy:  0.756, Loss:  0.908\n",
      "Epoch   4 Batch   42/78 - Train Accuracy:  0.746, Validation Accuracy:  0.758, Loss:  0.839\n",
      "Epoch   4 Batch   43/78 - Train Accuracy:  0.721, Validation Accuracy:  0.749, Loss:  0.917\n",
      "Epoch   4 Batch   44/78 - Train Accuracy:  0.729, Validation Accuracy:  0.749, Loss:  0.828\n",
      "Epoch   4 Batch   45/78 - Train Accuracy:  0.763, Validation Accuracy:  0.750, Loss:  0.839\n",
      "Epoch   4 Batch   46/78 - Train Accuracy:  0.731, Validation Accuracy:  0.753, Loss:  0.904\n",
      "Epoch   4 Batch   47/78 - Train Accuracy:  0.751, Validation Accuracy:  0.752, Loss:  0.777\n",
      "Epoch   4 Batch   48/78 - Train Accuracy:  0.771, Validation Accuracy:  0.753, Loss:  0.765\n",
      "Epoch   4 Batch   49/78 - Train Accuracy:  0.751, Validation Accuracy:  0.756, Loss:  0.871\n",
      "Epoch   4 Batch   50/78 - Train Accuracy:  0.720, Validation Accuracy:  0.761, Loss:  0.959\n",
      "Epoch   4 Batch   51/78 - Train Accuracy:  0.752, Validation Accuracy:  0.759, Loss:  0.822\n",
      "Epoch   4 Batch   52/78 - Train Accuracy:  0.741, Validation Accuracy:  0.759, Loss:  0.818\n",
      "Epoch   4 Batch   53/78 - Train Accuracy:  0.751, Validation Accuracy:  0.758, Loss:  0.816\n",
      "Epoch   4 Batch   54/78 - Train Accuracy:  0.766, Validation Accuracy:  0.757, Loss:  0.841\n",
      "Epoch   4 Batch   55/78 - Train Accuracy:  0.718, Validation Accuracy:  0.754, Loss:  0.870\n",
      "Epoch   4 Batch   56/78 - Train Accuracy:  0.737, Validation Accuracy:  0.762, Loss:  0.836\n",
      "Epoch   4 Batch   57/78 - Train Accuracy:  0.715, Validation Accuracy:  0.762, Loss:  0.875\n",
      "Epoch   4 Batch   58/78 - Train Accuracy:  0.732, Validation Accuracy:  0.768, Loss:  0.904\n",
      "Epoch   4 Batch   59/78 - Train Accuracy:  0.718, Validation Accuracy:  0.768, Loss:  0.867\n",
      "Epoch   4 Batch   60/78 - Train Accuracy:  0.786, Validation Accuracy:  0.768, Loss:  0.747\n",
      "Epoch   4 Batch   61/78 - Train Accuracy:  0.743, Validation Accuracy:  0.772, Loss:  0.863\n",
      "Epoch   4 Batch   62/78 - Train Accuracy:  0.749, Validation Accuracy:  0.766, Loss:  0.809\n",
      "Epoch   4 Batch   63/78 - Train Accuracy:  0.767, Validation Accuracy:  0.769, Loss:  0.766\n",
      "Epoch   4 Batch   64/78 - Train Accuracy:  0.746, Validation Accuracy:  0.771, Loss:  0.798\n",
      "Epoch   4 Batch   65/78 - Train Accuracy:  0.757, Validation Accuracy:  0.769, Loss:  0.785\n",
      "Epoch   4 Batch   66/78 - Train Accuracy:  0.785, Validation Accuracy:  0.773, Loss:  0.733\n",
      "Epoch   4 Batch   67/78 - Train Accuracy:  0.753, Validation Accuracy:  0.769, Loss:  0.766\n",
      "Epoch   4 Batch   68/78 - Train Accuracy:  0.762, Validation Accuracy:  0.773, Loss:  0.830\n",
      "Epoch   4 Batch   69/78 - Train Accuracy:  0.795, Validation Accuracy:  0.770, Loss:  0.691\n",
      "Epoch   4 Batch   70/78 - Train Accuracy:  0.746, Validation Accuracy:  0.767, Loss:  0.809\n",
      "Epoch   4 Batch   71/78 - Train Accuracy:  0.779, Validation Accuracy:  0.768, Loss:  0.746\n",
      "Epoch   4 Batch   72/78 - Train Accuracy:  0.740, Validation Accuracy:  0.767, Loss:  0.822\n",
      "Epoch   4 Batch   73/78 - Train Accuracy:  0.712, Validation Accuracy:  0.769, Loss:  0.913\n",
      "Epoch   4 Batch   74/78 - Train Accuracy:  0.758, Validation Accuracy:  0.768, Loss:  0.795\n",
      "Epoch   4 Batch   75/78 - Train Accuracy:  0.749, Validation Accuracy:  0.766, Loss:  0.811\n",
      "Epoch   4 Batch   76/78 - Train Accuracy:  0.756, Validation Accuracy:  0.775, Loss:  0.809\n",
      "Epoch   5 Batch    0/78 - Train Accuracy:  0.758, Validation Accuracy:  0.777, Loss:  0.819\n",
      "Epoch   5 Batch    1/78 - Train Accuracy:  0.766, Validation Accuracy:  0.768, Loss:  0.776\n",
      "Epoch   5 Batch    2/78 - Train Accuracy:  0.773, Validation Accuracy:  0.765, Loss:  0.726\n",
      "Epoch   5 Batch    3/78 - Train Accuracy:  0.767, Validation Accuracy:  0.768, Loss:  0.756\n",
      "Epoch   5 Batch    4/78 - Train Accuracy:  0.775, Validation Accuracy:  0.767, Loss:  0.761\n",
      "Epoch   5 Batch    5/78 - Train Accuracy:  0.772, Validation Accuracy:  0.769, Loss:  0.751\n",
      "Epoch   5 Batch    6/78 - Train Accuracy:  0.772, Validation Accuracy:  0.767, Loss:  0.769\n",
      "Epoch   5 Batch    7/78 - Train Accuracy:  0.770, Validation Accuracy:  0.768, Loss:  0.753\n",
      "Epoch   5 Batch    8/78 - Train Accuracy:  0.778, Validation Accuracy:  0.769, Loss:  0.785\n",
      "Epoch   5 Batch    9/78 - Train Accuracy:  0.788, Validation Accuracy:  0.769, Loss:  0.706\n",
      "Epoch   5 Batch   10/78 - Train Accuracy:  0.759, Validation Accuracy:  0.759, Loss:  0.788\n",
      "Epoch   5 Batch   11/78 - Train Accuracy:  0.759, Validation Accuracy:  0.767, Loss:  0.824\n",
      "Epoch   5 Batch   12/78 - Train Accuracy:  0.759, Validation Accuracy:  0.768, Loss:  0.805\n",
      "Epoch   5 Batch   13/78 - Train Accuracy:  0.740, Validation Accuracy:  0.767, Loss:  0.809\n",
      "Epoch   5 Batch   14/78 - Train Accuracy:  0.794, Validation Accuracy:  0.765, Loss:  0.673\n",
      "Epoch   5 Batch   15/78 - Train Accuracy:  0.762, Validation Accuracy:  0.772, Loss:  0.789\n",
      "Epoch   5 Batch   16/78 - Train Accuracy:  0.786, Validation Accuracy:  0.778, Loss:  0.716\n",
      "Epoch   5 Batch   17/78 - Train Accuracy:  0.780, Validation Accuracy:  0.771, Loss:  0.711\n",
      "Epoch   5 Batch   18/78 - Train Accuracy:  0.757, Validation Accuracy:  0.769, Loss:  0.779\n",
      "Epoch   5 Batch   19/78 - Train Accuracy:  0.785, Validation Accuracy:  0.773, Loss:  0.718\n",
      "Epoch   5 Batch   20/78 - Train Accuracy:  0.802, Validation Accuracy:  0.780, Loss:  0.671\n",
      "Epoch   5 Batch   21/78 - Train Accuracy:  0.762, Validation Accuracy:  0.781, Loss:  0.815\n",
      "Epoch   5 Batch   22/78 - Train Accuracy:  0.758, Validation Accuracy:  0.778, Loss:  0.778\n",
      "Epoch   5 Batch   23/78 - Train Accuracy:  0.806, Validation Accuracy:  0.779, Loss:  0.664\n",
      "Epoch   5 Batch   24/78 - Train Accuracy:  0.777, Validation Accuracy:  0.773, Loss:  0.730\n",
      "Epoch   5 Batch   25/78 - Train Accuracy:  0.771, Validation Accuracy:  0.780, Loss:  0.748\n",
      "Epoch   5 Batch   26/78 - Train Accuracy:  0.775, Validation Accuracy:  0.773, Loss:  0.795\n",
      "Epoch   5 Batch   27/78 - Train Accuracy:  0.772, Validation Accuracy:  0.782, Loss:  0.749\n",
      "Epoch   5 Batch   28/78 - Train Accuracy:  0.763, Validation Accuracy:  0.779, Loss:  0.769\n",
      "Epoch   5 Batch   29/78 - Train Accuracy:  0.781, Validation Accuracy:  0.775, Loss:  0.702\n",
      "Epoch   5 Batch   30/78 - Train Accuracy:  0.763, Validation Accuracy:  0.770, Loss:  0.735\n",
      "Epoch   5 Batch   31/78 - Train Accuracy:  0.782, Validation Accuracy:  0.771, Loss:  0.672\n",
      "Epoch   5 Batch   32/78 - Train Accuracy:  0.757, Validation Accuracy:  0.776, Loss:  0.713\n",
      "Epoch   5 Batch   33/78 - Train Accuracy:  0.767, Validation Accuracy:  0.783, Loss:  0.749\n",
      "Epoch   5 Batch   34/78 - Train Accuracy:  0.780, Validation Accuracy:  0.794, Loss:  0.723\n",
      "Epoch   5 Batch   35/78 - Train Accuracy:  0.767, Validation Accuracy:  0.789, Loss:  0.735\n",
      "Epoch   5 Batch   36/78 - Train Accuracy:  0.760, Validation Accuracy:  0.781, Loss:  0.755\n",
      "Epoch   5 Batch   37/78 - Train Accuracy:  0.767, Validation Accuracy:  0.778, Loss:  0.757\n",
      "Epoch   5 Batch   38/78 - Train Accuracy:  0.792, Validation Accuracy:  0.778, Loss:  0.710\n",
      "Epoch   5 Batch   39/78 - Train Accuracy:  0.763, Validation Accuracy:  0.772, Loss:  0.765\n",
      "Epoch   5 Batch   40/78 - Train Accuracy:  0.792, Validation Accuracy:  0.776, Loss:  0.705\n",
      "Epoch   5 Batch   41/78 - Train Accuracy:  0.748, Validation Accuracy:  0.773, Loss:  0.788\n",
      "Epoch   5 Batch   42/78 - Train Accuracy:  0.777, Validation Accuracy:  0.778, Loss:  0.716\n",
      "Epoch   5 Batch   43/78 - Train Accuracy:  0.753, Validation Accuracy:  0.777, Loss:  0.798\n",
      "Epoch   5 Batch   44/78 - Train Accuracy:  0.771, Validation Accuracy:  0.777, Loss:  0.710\n",
      "Epoch   5 Batch   45/78 - Train Accuracy:  0.789, Validation Accuracy:  0.789, Loss:  0.723\n",
      "Epoch   5 Batch   46/78 - Train Accuracy:  0.766, Validation Accuracy:  0.786, Loss:  0.767\n",
      "Epoch   5 Batch   47/78 - Train Accuracy:  0.781, Validation Accuracy:  0.790, Loss:  0.682\n",
      "Epoch   5 Batch   48/78 - Train Accuracy:  0.798, Validation Accuracy:  0.785, Loss:  0.647\n",
      "Epoch   5 Batch   49/78 - Train Accuracy:  0.785, Validation Accuracy:  0.789, Loss:  0.757\n",
      "Epoch   5 Batch   50/78 - Train Accuracy:  0.754, Validation Accuracy:  0.788, Loss:  0.822\n",
      "Epoch   5 Batch   51/78 - Train Accuracy:  0.777, Validation Accuracy:  0.787, Loss:  0.713\n",
      "Epoch   5 Batch   52/78 - Train Accuracy:  0.768, Validation Accuracy:  0.785, Loss:  0.697\n",
      "Epoch   5 Batch   53/78 - Train Accuracy:  0.781, Validation Accuracy:  0.787, Loss:  0.704\n",
      "Epoch   5 Batch   54/78 - Train Accuracy:  0.800, Validation Accuracy:  0.791, Loss:  0.713\n",
      "Epoch   5 Batch   55/78 - Train Accuracy:  0.761, Validation Accuracy:  0.791, Loss:  0.757\n",
      "Epoch   5 Batch   56/78 - Train Accuracy:  0.776, Validation Accuracy:  0.795, Loss:  0.704\n",
      "Epoch   5 Batch   57/78 - Train Accuracy:  0.773, Validation Accuracy:  0.799, Loss:  0.756\n",
      "Epoch   5 Batch   58/78 - Train Accuracy:  0.769, Validation Accuracy:  0.794, Loss:  0.779\n",
      "Epoch   5 Batch   59/78 - Train Accuracy:  0.761, Validation Accuracy:  0.798, Loss:  0.750\n",
      "Epoch   5 Batch   60/78 - Train Accuracy:  0.824, Validation Accuracy:  0.802, Loss:  0.639\n",
      "Epoch   5 Batch   61/78 - Train Accuracy:  0.772, Validation Accuracy:  0.808, Loss:  0.738\n",
      "Epoch   5 Batch   62/78 - Train Accuracy:  0.798, Validation Accuracy:  0.800, Loss:  0.690\n",
      "Epoch   5 Batch   63/78 - Train Accuracy:  0.808, Validation Accuracy:  0.798, Loss:  0.655\n",
      "Epoch   5 Batch   64/78 - Train Accuracy:  0.788, Validation Accuracy:  0.799, Loss:  0.684\n",
      "Epoch   5 Batch   65/78 - Train Accuracy:  0.782, Validation Accuracy:  0.802, Loss:  0.677\n",
      "Epoch   5 Batch   66/78 - Train Accuracy:  0.802, Validation Accuracy:  0.800, Loss:  0.620\n",
      "Epoch   5 Batch   67/78 - Train Accuracy:  0.795, Validation Accuracy:  0.799, Loss:  0.658\n",
      "Epoch   5 Batch   68/78 - Train Accuracy:  0.789, Validation Accuracy:  0.797, Loss:  0.714\n",
      "Epoch   5 Batch   69/78 - Train Accuracy:  0.819, Validation Accuracy:  0.804, Loss:  0.590\n",
      "Epoch   5 Batch   70/78 - Train Accuracy:  0.792, Validation Accuracy:  0.807, Loss:  0.699\n",
      "Epoch   5 Batch   71/78 - Train Accuracy:  0.818, Validation Accuracy:  0.802, Loss:  0.633\n",
      "Epoch   5 Batch   72/78 - Train Accuracy:  0.768, Validation Accuracy:  0.799, Loss:  0.707\n",
      "Epoch   5 Batch   73/78 - Train Accuracy:  0.753, Validation Accuracy:  0.799, Loss:  0.790\n",
      "Epoch   5 Batch   74/78 - Train Accuracy:  0.787, Validation Accuracy:  0.804, Loss:  0.686\n",
      "Epoch   5 Batch   75/78 - Train Accuracy:  0.781, Validation Accuracy:  0.808, Loss:  0.698\n",
      "Epoch   5 Batch   76/78 - Train Accuracy:  0.790, Validation Accuracy:  0.810, Loss:  0.691\n",
      "Epoch   6 Batch    0/78 - Train Accuracy:  0.783, Validation Accuracy:  0.805, Loss:  0.702\n",
      "Epoch   6 Batch    1/78 - Train Accuracy:  0.807, Validation Accuracy:  0.802, Loss:  0.665\n",
      "Epoch   6 Batch    2/78 - Train Accuracy:  0.802, Validation Accuracy:  0.805, Loss:  0.627\n",
      "Epoch   6 Batch    3/78 - Train Accuracy:  0.799, Validation Accuracy:  0.802, Loss:  0.659\n",
      "Epoch   6 Batch    4/78 - Train Accuracy:  0.805, Validation Accuracy:  0.805, Loss:  0.654\n",
      "Epoch   6 Batch    5/78 - Train Accuracy:  0.815, Validation Accuracy:  0.801, Loss:  0.632\n",
      "Epoch   6 Batch    6/78 - Train Accuracy:  0.815, Validation Accuracy:  0.800, Loss:  0.663\n",
      "Epoch   6 Batch    7/78 - Train Accuracy:  0.809, Validation Accuracy:  0.799, Loss:  0.641\n",
      "Epoch   6 Batch    8/78 - Train Accuracy:  0.796, Validation Accuracy:  0.799, Loss:  0.664\n",
      "Epoch   6 Batch    9/78 - Train Accuracy:  0.825, Validation Accuracy:  0.800, Loss:  0.605\n",
      "Epoch   6 Batch   10/78 - Train Accuracy:  0.786, Validation Accuracy:  0.797, Loss:  0.676\n",
      "Epoch   6 Batch   11/78 - Train Accuracy:  0.777, Validation Accuracy:  0.806, Loss:  0.713\n",
      "Epoch   6 Batch   12/78 - Train Accuracy:  0.800, Validation Accuracy:  0.801, Loss:  0.700\n",
      "Epoch   6 Batch   13/78 - Train Accuracy:  0.773, Validation Accuracy:  0.798, Loss:  0.705\n",
      "Epoch   6 Batch   14/78 - Train Accuracy:  0.830, Validation Accuracy:  0.802, Loss:  0.573\n",
      "Epoch   6 Batch   15/78 - Train Accuracy:  0.791, Validation Accuracy:  0.808, Loss:  0.683\n",
      "Epoch   6 Batch   16/78 - Train Accuracy:  0.819, Validation Accuracy:  0.806, Loss:  0.619\n",
      "Epoch   6 Batch   17/78 - Train Accuracy:  0.809, Validation Accuracy:  0.801, Loss:  0.615\n",
      "Epoch   6 Batch   18/78 - Train Accuracy:  0.792, Validation Accuracy:  0.799, Loss:  0.669\n",
      "Epoch   6 Batch   19/78 - Train Accuracy:  0.810, Validation Accuracy:  0.799, Loss:  0.622\n",
      "Epoch   6 Batch   20/78 - Train Accuracy:  0.844, Validation Accuracy:  0.806, Loss:  0.570\n",
      "Epoch   6 Batch   21/78 - Train Accuracy:  0.792, Validation Accuracy:  0.812, Loss:  0.707\n",
      "Epoch   6 Batch   22/78 - Train Accuracy:  0.779, Validation Accuracy:  0.811, Loss:  0.677\n",
      "Epoch   6 Batch   23/78 - Train Accuracy:  0.824, Validation Accuracy:  0.809, Loss:  0.574\n",
      "Epoch   6 Batch   24/78 - Train Accuracy:  0.805, Validation Accuracy:  0.812, Loss:  0.633\n",
      "Epoch   6 Batch   25/78 - Train Accuracy:  0.801, Validation Accuracy:  0.808, Loss:  0.645\n",
      "Epoch   6 Batch   26/78 - Train Accuracy:  0.791, Validation Accuracy:  0.805, Loss:  0.688\n",
      "Epoch   6 Batch   27/78 - Train Accuracy:  0.799, Validation Accuracy:  0.808, Loss:  0.650\n",
      "Epoch   6 Batch   28/78 - Train Accuracy:  0.794, Validation Accuracy:  0.806, Loss:  0.658\n",
      "Epoch   6 Batch   29/78 - Train Accuracy:  0.809, Validation Accuracy:  0.804, Loss:  0.613\n",
      "Epoch   6 Batch   30/78 - Train Accuracy:  0.799, Validation Accuracy:  0.808, Loss:  0.636\n",
      "Epoch   6 Batch   31/78 - Train Accuracy:  0.820, Validation Accuracy:  0.808, Loss:  0.582\n",
      "Epoch   6 Batch   32/78 - Train Accuracy:  0.795, Validation Accuracy:  0.811, Loss:  0.615\n",
      "Epoch   6 Batch   33/78 - Train Accuracy:  0.789, Validation Accuracy:  0.815, Loss:  0.656\n",
      "Epoch   6 Batch   34/78 - Train Accuracy:  0.807, Validation Accuracy:  0.816, Loss:  0.622\n",
      "Epoch   6 Batch   35/78 - Train Accuracy:  0.801, Validation Accuracy:  0.811, Loss:  0.645\n",
      "Epoch   6 Batch   36/78 - Train Accuracy:  0.787, Validation Accuracy:  0.811, Loss:  0.664\n",
      "Epoch   6 Batch   37/78 - Train Accuracy:  0.782, Validation Accuracy:  0.810, Loss:  0.660\n",
      "Epoch   6 Batch   38/78 - Train Accuracy:  0.819, Validation Accuracy:  0.808, Loss:  0.616\n",
      "Epoch   6 Batch   39/78 - Train Accuracy:  0.782, Validation Accuracy:  0.807, Loss:  0.663\n",
      "Epoch   6 Batch   40/78 - Train Accuracy:  0.817, Validation Accuracy:  0.815, Loss:  0.616\n",
      "Epoch   6 Batch   41/78 - Train Accuracy:  0.787, Validation Accuracy:  0.810, Loss:  0.691\n",
      "Epoch   6 Batch   42/78 - Train Accuracy:  0.798, Validation Accuracy:  0.815, Loss:  0.625\n",
      "Epoch   6 Batch   43/78 - Train Accuracy:  0.778, Validation Accuracy:  0.807, Loss:  0.700\n",
      "Epoch   6 Batch   44/78 - Train Accuracy:  0.796, Validation Accuracy:  0.812, Loss:  0.625\n",
      "Epoch   6 Batch   45/78 - Train Accuracy:  0.818, Validation Accuracy:  0.814, Loss:  0.632\n",
      "Epoch   6 Batch   46/78 - Train Accuracy:  0.786, Validation Accuracy:  0.817, Loss:  0.673\n",
      "Epoch   6 Batch   47/78 - Train Accuracy:  0.806, Validation Accuracy:  0.815, Loss:  0.599\n",
      "Epoch   6 Batch   48/78 - Train Accuracy:  0.826, Validation Accuracy:  0.809, Loss:  0.566\n",
      "Epoch   6 Batch   49/78 - Train Accuracy:  0.801, Validation Accuracy:  0.815, Loss:  0.664\n",
      "Epoch   6 Batch   50/78 - Train Accuracy:  0.769, Validation Accuracy:  0.816, Loss:  0.731\n",
      "Epoch   6 Batch   51/78 - Train Accuracy:  0.804, Validation Accuracy:  0.814, Loss:  0.626\n",
      "Epoch   6 Batch   52/78 - Train Accuracy:  0.808, Validation Accuracy:  0.815, Loss:  0.606\n",
      "Epoch   6 Batch   53/78 - Train Accuracy:  0.808, Validation Accuracy:  0.814, Loss:  0.615\n",
      "Epoch   6 Batch   54/78 - Train Accuracy:  0.830, Validation Accuracy:  0.815, Loss:  0.625\n",
      "Epoch   6 Batch   55/78 - Train Accuracy:  0.775, Validation Accuracy:  0.807, Loss:  0.671\n",
      "Epoch   6 Batch   56/78 - Train Accuracy:  0.801, Validation Accuracy:  0.810, Loss:  0.613\n",
      "Epoch   6 Batch   57/78 - Train Accuracy:  0.795, Validation Accuracy:  0.815, Loss:  0.662\n",
      "Epoch   6 Batch   58/78 - Train Accuracy:  0.799, Validation Accuracy:  0.821, Loss:  0.686\n",
      "Epoch   6 Batch   59/78 - Train Accuracy:  0.776, Validation Accuracy:  0.825, Loss:  0.660\n",
      "Epoch   6 Batch   60/78 - Train Accuracy:  0.834, Validation Accuracy:  0.821, Loss:  0.558\n",
      "Epoch   6 Batch   61/78 - Train Accuracy:  0.814, Validation Accuracy:  0.817, Loss:  0.650\n",
      "Epoch   6 Batch   62/78 - Train Accuracy:  0.814, Validation Accuracy:  0.820, Loss:  0.602\n",
      "Epoch   6 Batch   63/78 - Train Accuracy:  0.825, Validation Accuracy:  0.823, Loss:  0.577\n",
      "Epoch   6 Batch   64/78 - Train Accuracy:  0.807, Validation Accuracy:  0.823, Loss:  0.603\n",
      "Epoch   6 Batch   65/78 - Train Accuracy:  0.810, Validation Accuracy:  0.823, Loss:  0.598\n",
      "Epoch   6 Batch   66/78 - Train Accuracy:  0.827, Validation Accuracy:  0.821, Loss:  0.542\n",
      "Epoch   6 Batch   67/78 - Train Accuracy:  0.811, Validation Accuracy:  0.821, Loss:  0.581\n",
      "Epoch   6 Batch   68/78 - Train Accuracy:  0.810, Validation Accuracy:  0.820, Loss:  0.632\n",
      "Epoch   6 Batch   69/78 - Train Accuracy:  0.850, Validation Accuracy:  0.821, Loss:  0.516\n",
      "Epoch   6 Batch   70/78 - Train Accuracy:  0.815, Validation Accuracy:  0.824, Loss:  0.621\n",
      "Epoch   6 Batch   71/78 - Train Accuracy:  0.836, Validation Accuracy:  0.826, Loss:  0.552\n",
      "Epoch   6 Batch   72/78 - Train Accuracy:  0.789, Validation Accuracy:  0.819, Loss:  0.629\n",
      "Epoch   6 Batch   73/78 - Train Accuracy:  0.773, Validation Accuracy:  0.819, Loss:  0.697\n",
      "Epoch   6 Batch   74/78 - Train Accuracy:  0.809, Validation Accuracy:  0.821, Loss:  0.606\n",
      "Epoch   6 Batch   75/78 - Train Accuracy:  0.812, Validation Accuracy:  0.824, Loss:  0.616\n",
      "Epoch   6 Batch   76/78 - Train Accuracy:  0.802, Validation Accuracy:  0.823, Loss:  0.605\n",
      "Epoch   7 Batch    0/78 - Train Accuracy:  0.799, Validation Accuracy:  0.818, Loss:  0.620\n",
      "Epoch   7 Batch    1/78 - Train Accuracy:  0.825, Validation Accuracy:  0.825, Loss:  0.589\n",
      "Epoch   7 Batch    2/78 - Train Accuracy:  0.824, Validation Accuracy:  0.823, Loss:  0.553\n",
      "Epoch   7 Batch    3/78 - Train Accuracy:  0.817, Validation Accuracy:  0.821, Loss:  0.590\n",
      "Epoch   7 Batch    4/78 - Train Accuracy:  0.821, Validation Accuracy:  0.820, Loss:  0.575\n",
      "Epoch   7 Batch    5/78 - Train Accuracy:  0.836, Validation Accuracy:  0.825, Loss:  0.557\n",
      "Epoch   7 Batch    6/78 - Train Accuracy:  0.825, Validation Accuracy:  0.821, Loss:  0.584\n",
      "Epoch   7 Batch    7/78 - Train Accuracy:  0.829, Validation Accuracy:  0.823, Loss:  0.566\n",
      "Epoch   7 Batch    8/78 - Train Accuracy:  0.821, Validation Accuracy:  0.825, Loss:  0.578\n",
      "Epoch   7 Batch    9/78 - Train Accuracy:  0.847, Validation Accuracy:  0.827, Loss:  0.532\n",
      "Epoch   7 Batch   10/78 - Train Accuracy:  0.824, Validation Accuracy:  0.827, Loss:  0.593\n",
      "Epoch   7 Batch   11/78 - Train Accuracy:  0.797, Validation Accuracy:  0.829, Loss:  0.630\n",
      "Epoch   7 Batch   12/78 - Train Accuracy:  0.814, Validation Accuracy:  0.827, Loss:  0.627\n",
      "Epoch   7 Batch   13/78 - Train Accuracy:  0.798, Validation Accuracy:  0.823, Loss:  0.625\n",
      "Epoch   7 Batch   14/78 - Train Accuracy:  0.842, Validation Accuracy:  0.828, Loss:  0.506\n",
      "Epoch   7 Batch   15/78 - Train Accuracy:  0.806, Validation Accuracy:  0.824, Loss:  0.603\n",
      "Epoch   7 Batch   16/78 - Train Accuracy:  0.834, Validation Accuracy:  0.831, Loss:  0.542\n",
      "Epoch   7 Batch   17/78 - Train Accuracy:  0.821, Validation Accuracy:  0.827, Loss:  0.542\n",
      "Epoch   7 Batch   18/78 - Train Accuracy:  0.817, Validation Accuracy:  0.833, Loss:  0.590\n",
      "Epoch   7 Batch   19/78 - Train Accuracy:  0.835, Validation Accuracy:  0.829, Loss:  0.549\n",
      "Epoch   7 Batch   20/78 - Train Accuracy:  0.856, Validation Accuracy:  0.828, Loss:  0.495\n",
      "Epoch   7 Batch   21/78 - Train Accuracy:  0.812, Validation Accuracy:  0.827, Loss:  0.626\n",
      "Epoch   7 Batch   22/78 - Train Accuracy:  0.806, Validation Accuracy:  0.830, Loss:  0.599\n",
      "Epoch   7 Batch   23/78 - Train Accuracy:  0.830, Validation Accuracy:  0.831, Loss:  0.511\n",
      "Epoch   7 Batch   24/78 - Train Accuracy:  0.837, Validation Accuracy:  0.836, Loss:  0.554\n",
      "Epoch   7 Batch   25/78 - Train Accuracy:  0.815, Validation Accuracy:  0.835, Loss:  0.570\n",
      "Epoch   7 Batch   26/78 - Train Accuracy:  0.809, Validation Accuracy:  0.833, Loss:  0.609\n",
      "Epoch   7 Batch   27/78 - Train Accuracy:  0.818, Validation Accuracy:  0.833, Loss:  0.577\n",
      "Epoch   7 Batch   28/78 - Train Accuracy:  0.811, Validation Accuracy:  0.834, Loss:  0.577\n",
      "Epoch   7 Batch   29/78 - Train Accuracy:  0.828, Validation Accuracy:  0.835, Loss:  0.544\n",
      "Epoch   7 Batch   30/78 - Train Accuracy:  0.826, Validation Accuracy:  0.834, Loss:  0.560\n",
      "Epoch   7 Batch   31/78 - Train Accuracy:  0.843, Validation Accuracy:  0.835, Loss:  0.516\n",
      "Epoch   7 Batch   32/78 - Train Accuracy:  0.821, Validation Accuracy:  0.829, Loss:  0.540\n",
      "Epoch   7 Batch   33/78 - Train Accuracy:  0.824, Validation Accuracy:  0.831, Loss:  0.584\n",
      "Epoch   7 Batch   34/78 - Train Accuracy:  0.830, Validation Accuracy:  0.827, Loss:  0.548\n",
      "Epoch   7 Batch   35/78 - Train Accuracy:  0.815, Validation Accuracy:  0.835, Loss:  0.572\n",
      "Epoch   7 Batch   36/78 - Train Accuracy:  0.808, Validation Accuracy:  0.826, Loss:  0.589\n",
      "Epoch   7 Batch   37/78 - Train Accuracy:  0.811, Validation Accuracy:  0.827, Loss:  0.585\n",
      "Epoch   7 Batch   38/78 - Train Accuracy:  0.839, Validation Accuracy:  0.828, Loss:  0.543\n",
      "Epoch   7 Batch   39/78 - Train Accuracy:  0.802, Validation Accuracy:  0.828, Loss:  0.585\n",
      "Epoch   7 Batch   40/78 - Train Accuracy:  0.840, Validation Accuracy:  0.828, Loss:  0.543\n",
      "Epoch   7 Batch   41/78 - Train Accuracy:  0.796, Validation Accuracy:  0.828, Loss:  0.610\n",
      "Epoch   7 Batch   42/78 - Train Accuracy:  0.820, Validation Accuracy:  0.829, Loss:  0.549\n",
      "Epoch   7 Batch   43/78 - Train Accuracy:  0.802, Validation Accuracy:  0.833, Loss:  0.617\n",
      "Epoch   7 Batch   44/78 - Train Accuracy:  0.810, Validation Accuracy:  0.829, Loss:  0.554\n",
      "Epoch   7 Batch   45/78 - Train Accuracy:  0.836, Validation Accuracy:  0.836, Loss:  0.560\n",
      "Epoch   7 Batch   46/78 - Train Accuracy:  0.801, Validation Accuracy:  0.836, Loss:  0.597\n",
      "Epoch   7 Batch   47/78 - Train Accuracy:  0.834, Validation Accuracy:  0.835, Loss:  0.525\n",
      "Epoch   7 Batch   48/78 - Train Accuracy:  0.856, Validation Accuracy:  0.833, Loss:  0.497\n",
      "Epoch   7 Batch   49/78 - Train Accuracy:  0.821, Validation Accuracy:  0.837, Loss:  0.581\n",
      "Epoch   7 Batch   50/78 - Train Accuracy:  0.792, Validation Accuracy:  0.839, Loss:  0.654\n",
      "Epoch   7 Batch   51/78 - Train Accuracy:  0.828, Validation Accuracy:  0.846, Loss:  0.554\n",
      "Epoch   7 Batch   52/78 - Train Accuracy:  0.838, Validation Accuracy:  0.840, Loss:  0.527\n",
      "Epoch   7 Batch   53/78 - Train Accuracy:  0.825, Validation Accuracy:  0.845, Loss:  0.541\n",
      "Epoch   7 Batch   54/78 - Train Accuracy:  0.847, Validation Accuracy:  0.839, Loss:  0.556\n",
      "Epoch   7 Batch   55/78 - Train Accuracy:  0.814, Validation Accuracy:  0.839, Loss:  0.589\n",
      "Epoch   7 Batch   56/78 - Train Accuracy:  0.830, Validation Accuracy:  0.842, Loss:  0.536\n",
      "Epoch   7 Batch   57/78 - Train Accuracy:  0.818, Validation Accuracy:  0.846, Loss:  0.586\n",
      "Epoch   7 Batch   58/78 - Train Accuracy:  0.823, Validation Accuracy:  0.847, Loss:  0.607\n",
      "Epoch   7 Batch   59/78 - Train Accuracy:  0.804, Validation Accuracy:  0.843, Loss:  0.581\n",
      "Epoch   7 Batch   60/78 - Train Accuracy:  0.855, Validation Accuracy:  0.843, Loss:  0.491\n",
      "Epoch   7 Batch   61/78 - Train Accuracy:  0.843, Validation Accuracy:  0.844, Loss:  0.573\n",
      "Epoch   7 Batch   62/78 - Train Accuracy:  0.837, Validation Accuracy:  0.845, Loss:  0.532\n",
      "Epoch   7 Batch   63/78 - Train Accuracy:  0.837, Validation Accuracy:  0.842, Loss:  0.507\n",
      "Epoch   7 Batch   64/78 - Train Accuracy:  0.835, Validation Accuracy:  0.840, Loss:  0.534\n",
      "Epoch   7 Batch   65/78 - Train Accuracy:  0.833, Validation Accuracy:  0.845, Loss:  0.531\n",
      "Epoch   7 Batch   66/78 - Train Accuracy:  0.854, Validation Accuracy:  0.848, Loss:  0.479\n",
      "Epoch   7 Batch   67/78 - Train Accuracy:  0.845, Validation Accuracy:  0.847, Loss:  0.516\n",
      "Epoch   7 Batch   68/78 - Train Accuracy:  0.824, Validation Accuracy:  0.842, Loss:  0.564\n",
      "Epoch   7 Batch   69/78 - Train Accuracy:  0.853, Validation Accuracy:  0.844, Loss:  0.452\n",
      "Epoch   7 Batch   70/78 - Train Accuracy:  0.831, Validation Accuracy:  0.846, Loss:  0.552\n",
      "Epoch   7 Batch   71/78 - Train Accuracy:  0.858, Validation Accuracy:  0.846, Loss:  0.482\n",
      "Epoch   7 Batch   72/78 - Train Accuracy:  0.808, Validation Accuracy:  0.850, Loss:  0.561\n",
      "Epoch   7 Batch   73/78 - Train Accuracy:  0.802, Validation Accuracy:  0.848, Loss:  0.615\n",
      "Epoch   7 Batch   74/78 - Train Accuracy:  0.835, Validation Accuracy:  0.847, Loss:  0.543\n",
      "Epoch   7 Batch   75/78 - Train Accuracy:  0.828, Validation Accuracy:  0.850, Loss:  0.543\n",
      "Epoch   7 Batch   76/78 - Train Accuracy:  0.818, Validation Accuracy:  0.846, Loss:  0.533\n",
      "Epoch   8 Batch    0/78 - Train Accuracy:  0.812, Validation Accuracy:  0.846, Loss:  0.548\n",
      "Epoch   8 Batch    1/78 - Train Accuracy:  0.852, Validation Accuracy:  0.846, Loss:  0.519\n",
      "Epoch   8 Batch    2/78 - Train Accuracy:  0.839, Validation Accuracy:  0.845, Loss:  0.487\n",
      "Epoch   8 Batch    3/78 - Train Accuracy:  0.826, Validation Accuracy:  0.846, Loss:  0.527\n",
      "Epoch   8 Batch    4/78 - Train Accuracy:  0.837, Validation Accuracy:  0.845, Loss:  0.509\n",
      "Epoch   8 Batch    5/78 - Train Accuracy:  0.856, Validation Accuracy:  0.845, Loss:  0.494\n",
      "Epoch   8 Batch    6/78 - Train Accuracy:  0.834, Validation Accuracy:  0.845, Loss:  0.515\n",
      "Epoch   8 Batch    7/78 - Train Accuracy:  0.858, Validation Accuracy:  0.850, Loss:  0.506\n",
      "Epoch   8 Batch    8/78 - Train Accuracy:  0.847, Validation Accuracy:  0.846, Loss:  0.507\n",
      "Epoch   8 Batch    9/78 - Train Accuracy:  0.867, Validation Accuracy:  0.845, Loss:  0.469\n",
      "Epoch   8 Batch   10/78 - Train Accuracy:  0.844, Validation Accuracy:  0.847, Loss:  0.520\n",
      "Epoch   8 Batch   11/78 - Train Accuracy:  0.824, Validation Accuracy:  0.850, Loss:  0.561\n",
      "Epoch   8 Batch   12/78 - Train Accuracy:  0.827, Validation Accuracy:  0.838, Loss:  0.558\n",
      "Epoch   8 Batch   13/78 - Train Accuracy:  0.814, Validation Accuracy:  0.846, Loss:  0.556\n",
      "Epoch   8 Batch   14/78 - Train Accuracy:  0.856, Validation Accuracy:  0.849, Loss:  0.445\n",
      "Epoch   8 Batch   15/78 - Train Accuracy:  0.820, Validation Accuracy:  0.848, Loss:  0.537\n",
      "Epoch   8 Batch   16/78 - Train Accuracy:  0.849, Validation Accuracy:  0.853, Loss:  0.475\n",
      "Epoch   8 Batch   17/78 - Train Accuracy:  0.843, Validation Accuracy:  0.847, Loss:  0.482\n",
      "Epoch   8 Batch   18/78 - Train Accuracy:  0.834, Validation Accuracy:  0.849, Loss:  0.523\n",
      "Epoch   8 Batch   19/78 - Train Accuracy:  0.850, Validation Accuracy:  0.847, Loss:  0.486\n",
      "Epoch   8 Batch   20/78 - Train Accuracy:  0.871, Validation Accuracy:  0.854, Loss:  0.432\n",
      "Epoch   8 Batch   21/78 - Train Accuracy:  0.843, Validation Accuracy:  0.852, Loss:  0.551\n",
      "Epoch   8 Batch   22/78 - Train Accuracy:  0.827, Validation Accuracy:  0.852, Loss:  0.529\n",
      "Epoch   8 Batch   23/78 - Train Accuracy:  0.848, Validation Accuracy:  0.854, Loss:  0.454\n",
      "Epoch   8 Batch   24/78 - Train Accuracy:  0.847, Validation Accuracy:  0.854, Loss:  0.484\n",
      "Epoch   8 Batch   25/78 - Train Accuracy:  0.834, Validation Accuracy:  0.855, Loss:  0.506\n",
      "Epoch   8 Batch   26/78 - Train Accuracy:  0.821, Validation Accuracy:  0.853, Loss:  0.541\n",
      "Epoch   8 Batch   27/78 - Train Accuracy:  0.846, Validation Accuracy:  0.854, Loss:  0.512\n",
      "Epoch   8 Batch   28/78 - Train Accuracy:  0.823, Validation Accuracy:  0.857, Loss:  0.508\n",
      "Epoch   8 Batch   29/78 - Train Accuracy:  0.839, Validation Accuracy:  0.863, Loss:  0.484\n",
      "Epoch   8 Batch   30/78 - Train Accuracy:  0.845, Validation Accuracy:  0.860, Loss:  0.500\n",
      "Epoch   8 Batch   31/78 - Train Accuracy:  0.862, Validation Accuracy:  0.858, Loss:  0.458\n",
      "Epoch   8 Batch   32/78 - Train Accuracy:  0.829, Validation Accuracy:  0.856, Loss:  0.477\n",
      "Epoch   8 Batch   33/78 - Train Accuracy:  0.838, Validation Accuracy:  0.849, Loss:  0.520\n",
      "Epoch   8 Batch   34/78 - Train Accuracy:  0.853, Validation Accuracy:  0.855, Loss:  0.484\n",
      "Epoch   8 Batch   35/78 - Train Accuracy:  0.846, Validation Accuracy:  0.853, Loss:  0.507\n",
      "Epoch   8 Batch   36/78 - Train Accuracy:  0.830, Validation Accuracy:  0.852, Loss:  0.523\n",
      "Epoch   8 Batch   37/78 - Train Accuracy:  0.837, Validation Accuracy:  0.849, Loss:  0.516\n",
      "Epoch   8 Batch   38/78 - Train Accuracy:  0.854, Validation Accuracy:  0.852, Loss:  0.479\n",
      "Epoch   8 Batch   39/78 - Train Accuracy:  0.836, Validation Accuracy:  0.848, Loss:  0.517\n",
      "Epoch   8 Batch   40/78 - Train Accuracy:  0.864, Validation Accuracy:  0.846, Loss:  0.478\n",
      "Epoch   8 Batch   41/78 - Train Accuracy:  0.826, Validation Accuracy:  0.844, Loss:  0.541\n",
      "Epoch   8 Batch   42/78 - Train Accuracy:  0.835, Validation Accuracy:  0.844, Loss:  0.485\n",
      "Epoch   8 Batch   43/78 - Train Accuracy:  0.817, Validation Accuracy:  0.848, Loss:  0.551\n",
      "Epoch   8 Batch   44/78 - Train Accuracy:  0.831, Validation Accuracy:  0.855, Loss:  0.493\n",
      "Epoch   8 Batch   45/78 - Train Accuracy:  0.846, Validation Accuracy:  0.848, Loss:  0.500\n",
      "Epoch   8 Batch   46/78 - Train Accuracy:  0.817, Validation Accuracy:  0.854, Loss:  0.532\n",
      "Epoch   8 Batch   47/78 - Train Accuracy:  0.843, Validation Accuracy:  0.857, Loss:  0.467\n",
      "Epoch   8 Batch   48/78 - Train Accuracy:  0.866, Validation Accuracy:  0.863, Loss:  0.436\n",
      "Epoch   8 Batch   49/78 - Train Accuracy:  0.839, Validation Accuracy:  0.857, Loss:  0.515\n",
      "Epoch   8 Batch   50/78 - Train Accuracy:  0.802, Validation Accuracy:  0.860, Loss:  0.588\n",
      "Epoch   8 Batch   51/78 - Train Accuracy:  0.850, Validation Accuracy:  0.869, Loss:  0.495\n",
      "Epoch   8 Batch   52/78 - Train Accuracy:  0.857, Validation Accuracy:  0.871, Loss:  0.464\n",
      "Epoch   8 Batch   53/78 - Train Accuracy:  0.838, Validation Accuracy:  0.866, Loss:  0.486\n",
      "Epoch   8 Batch   54/78 - Train Accuracy:  0.856, Validation Accuracy:  0.871, Loss:  0.496\n",
      "Epoch   8 Batch   55/78 - Train Accuracy:  0.834, Validation Accuracy:  0.867, Loss:  0.525\n",
      "Epoch   8 Batch   56/78 - Train Accuracy:  0.844, Validation Accuracy:  0.868, Loss:  0.472\n",
      "Epoch   8 Batch   57/78 - Train Accuracy:  0.845, Validation Accuracy:  0.859, Loss:  0.527\n",
      "Epoch   8 Batch   58/78 - Train Accuracy:  0.836, Validation Accuracy:  0.860, Loss:  0.539\n",
      "Epoch   8 Batch   59/78 - Train Accuracy:  0.825, Validation Accuracy:  0.862, Loss:  0.520\n",
      "Epoch   8 Batch   60/78 - Train Accuracy:  0.865, Validation Accuracy:  0.864, Loss:  0.435\n",
      "Epoch   8 Batch   61/78 - Train Accuracy:  0.856, Validation Accuracy:  0.860, Loss:  0.513\n",
      "Epoch   8 Batch   62/78 - Train Accuracy:  0.853, Validation Accuracy:  0.869, Loss:  0.471\n",
      "Epoch   8 Batch   63/78 - Train Accuracy:  0.854, Validation Accuracy:  0.875, Loss:  0.452\n",
      "Epoch   8 Batch   64/78 - Train Accuracy:  0.846, Validation Accuracy:  0.866, Loss:  0.479\n",
      "Epoch   8 Batch   65/78 - Train Accuracy:  0.845, Validation Accuracy:  0.872, Loss:  0.476\n",
      "Epoch   8 Batch   66/78 - Train Accuracy:  0.865, Validation Accuracy:  0.874, Loss:  0.431\n",
      "Epoch   8 Batch   67/78 - Train Accuracy:  0.857, Validation Accuracy:  0.868, Loss:  0.459\n",
      "Epoch   8 Batch   68/78 - Train Accuracy:  0.837, Validation Accuracy:  0.866, Loss:  0.512\n",
      "Epoch   8 Batch   69/78 - Train Accuracy:  0.869, Validation Accuracy:  0.863, Loss:  0.399\n",
      "Epoch   8 Batch   70/78 - Train Accuracy:  0.847, Validation Accuracy:  0.867, Loss:  0.496\n",
      "Epoch   8 Batch   71/78 - Train Accuracy:  0.877, Validation Accuracy:  0.862, Loss:  0.422\n",
      "Epoch   8 Batch   72/78 - Train Accuracy:  0.831, Validation Accuracy:  0.868, Loss:  0.501\n",
      "Epoch   8 Batch   73/78 - Train Accuracy:  0.811, Validation Accuracy:  0.866, Loss:  0.543\n",
      "Epoch   8 Batch   74/78 - Train Accuracy:  0.847, Validation Accuracy:  0.867, Loss:  0.493\n",
      "Epoch   8 Batch   75/78 - Train Accuracy:  0.845, Validation Accuracy:  0.865, Loss:  0.474\n",
      "Epoch   8 Batch   76/78 - Train Accuracy:  0.853, Validation Accuracy:  0.863, Loss:  0.479\n",
      "Epoch   9 Batch    0/78 - Train Accuracy:  0.831, Validation Accuracy:  0.868, Loss:  0.483\n",
      "Epoch   9 Batch    1/78 - Train Accuracy:  0.860, Validation Accuracy:  0.867, Loss:  0.458\n",
      "Epoch   9 Batch    2/78 - Train Accuracy:  0.864, Validation Accuracy:  0.866, Loss:  0.430\n",
      "Epoch   9 Batch    3/78 - Train Accuracy:  0.842, Validation Accuracy:  0.860, Loss:  0.465\n",
      "Epoch   9 Batch    4/78 - Train Accuracy:  0.862, Validation Accuracy:  0.866, Loss:  0.451\n",
      "Epoch   9 Batch    5/78 - Train Accuracy:  0.873, Validation Accuracy:  0.871, Loss:  0.432\n",
      "Epoch   9 Batch    6/78 - Train Accuracy:  0.865, Validation Accuracy:  0.866, Loss:  0.460\n",
      "Epoch   9 Batch    7/78 - Train Accuracy:  0.866, Validation Accuracy:  0.868, Loss:  0.448\n",
      "Epoch   9 Batch    8/78 - Train Accuracy:  0.872, Validation Accuracy:  0.866, Loss:  0.451\n",
      "Epoch   9 Batch    9/78 - Train Accuracy:  0.875, Validation Accuracy:  0.864, Loss:  0.419\n",
      "Epoch   9 Batch   10/78 - Train Accuracy:  0.865, Validation Accuracy:  0.862, Loss:  0.458\n",
      "Epoch   9 Batch   11/78 - Train Accuracy:  0.839, Validation Accuracy:  0.863, Loss:  0.505\n",
      "Epoch   9 Batch   12/78 - Train Accuracy:  0.843, Validation Accuracy:  0.866, Loss:  0.495\n",
      "Epoch   9 Batch   13/78 - Train Accuracy:  0.848, Validation Accuracy:  0.866, Loss:  0.502\n",
      "Epoch   9 Batch   14/78 - Train Accuracy:  0.882, Validation Accuracy:  0.869, Loss:  0.392\n",
      "Epoch   9 Batch   15/78 - Train Accuracy:  0.838, Validation Accuracy:  0.869, Loss:  0.486\n",
      "Epoch   9 Batch   16/78 - Train Accuracy:  0.868, Validation Accuracy:  0.871, Loss:  0.419\n",
      "Epoch   9 Batch   17/78 - Train Accuracy:  0.867, Validation Accuracy:  0.874, Loss:  0.434\n",
      "Epoch   9 Batch   18/78 - Train Accuracy:  0.838, Validation Accuracy:  0.873, Loss:  0.469\n",
      "Epoch   9 Batch   19/78 - Train Accuracy:  0.864, Validation Accuracy:  0.871, Loss:  0.432\n",
      "Epoch   9 Batch   20/78 - Train Accuracy:  0.883, Validation Accuracy:  0.873, Loss:  0.386\n",
      "Epoch   9 Batch   21/78 - Train Accuracy:  0.849, Validation Accuracy:  0.872, Loss:  0.486\n",
      "Epoch   9 Batch   22/78 - Train Accuracy:  0.846, Validation Accuracy:  0.869, Loss:  0.469\n",
      "Epoch   9 Batch   23/78 - Train Accuracy:  0.867, Validation Accuracy:  0.874, Loss:  0.408\n",
      "Epoch   9 Batch   24/78 - Train Accuracy:  0.862, Validation Accuracy:  0.871, Loss:  0.427\n",
      "Epoch   9 Batch   25/78 - Train Accuracy:  0.843, Validation Accuracy:  0.868, Loss:  0.451\n",
      "Epoch   9 Batch   26/78 - Train Accuracy:  0.835, Validation Accuracy:  0.869, Loss:  0.483\n",
      "Epoch   9 Batch   27/78 - Train Accuracy:  0.859, Validation Accuracy:  0.876, Loss:  0.456\n",
      "Epoch   9 Batch   28/78 - Train Accuracy:  0.848, Validation Accuracy:  0.876, Loss:  0.450\n",
      "Epoch   9 Batch   29/78 - Train Accuracy:  0.855, Validation Accuracy:  0.881, Loss:  0.436\n",
      "Epoch   9 Batch   30/78 - Train Accuracy:  0.850, Validation Accuracy:  0.885, Loss:  0.447\n",
      "Epoch   9 Batch   31/78 - Train Accuracy:  0.873, Validation Accuracy:  0.883, Loss:  0.411\n",
      "Epoch   9 Batch   32/78 - Train Accuracy:  0.843, Validation Accuracy:  0.879, Loss:  0.427\n",
      "Epoch   9 Batch   33/78 - Train Accuracy:  0.845, Validation Accuracy:  0.874, Loss:  0.464\n",
      "Epoch   9 Batch   34/78 - Train Accuracy:  0.869, Validation Accuracy:  0.876, Loss:  0.434\n",
      "Epoch   9 Batch   35/78 - Train Accuracy:  0.860, Validation Accuracy:  0.875, Loss:  0.453\n",
      "Epoch   9 Batch   36/78 - Train Accuracy:  0.849, Validation Accuracy:  0.867, Loss:  0.463\n",
      "Epoch   9 Batch   37/78 - Train Accuracy:  0.857, Validation Accuracy:  0.876, Loss:  0.457\n",
      "Epoch   9 Batch   38/78 - Train Accuracy:  0.865, Validation Accuracy:  0.874, Loss:  0.427\n",
      "Epoch   9 Batch   39/78 - Train Accuracy:  0.865, Validation Accuracy:  0.875, Loss:  0.459\n",
      "Epoch   9 Batch   40/78 - Train Accuracy:  0.871, Validation Accuracy:  0.875, Loss:  0.424\n",
      "Epoch   9 Batch   41/78 - Train Accuracy:  0.846, Validation Accuracy:  0.875, Loss:  0.485\n",
      "Epoch   9 Batch   42/78 - Train Accuracy:  0.860, Validation Accuracy:  0.871, Loss:  0.432\n",
      "Epoch   9 Batch   43/78 - Train Accuracy:  0.828, Validation Accuracy:  0.862, Loss:  0.493\n",
      "Epoch   9 Batch   44/78 - Train Accuracy:  0.843, Validation Accuracy:  0.867, Loss:  0.440\n",
      "Epoch   9 Batch   45/78 - Train Accuracy:  0.860, Validation Accuracy:  0.867, Loss:  0.449\n",
      "Epoch   9 Batch   46/78 - Train Accuracy:  0.836, Validation Accuracy:  0.872, Loss:  0.474\n",
      "Epoch   9 Batch   47/78 - Train Accuracy:  0.859, Validation Accuracy:  0.877, Loss:  0.420\n",
      "Epoch   9 Batch   48/78 - Train Accuracy:  0.875, Validation Accuracy:  0.874, Loss:  0.381\n",
      "Epoch   9 Batch   49/78 - Train Accuracy:  0.853, Validation Accuracy:  0.875, Loss:  0.458\n",
      "Epoch   9 Batch   50/78 - Train Accuracy:  0.827, Validation Accuracy:  0.867, Loss:  0.522\n",
      "Epoch   9 Batch   51/78 - Train Accuracy:  0.865, Validation Accuracy:  0.876, Loss:  0.444\n",
      "Epoch   9 Batch   52/78 - Train Accuracy:  0.866, Validation Accuracy:  0.877, Loss:  0.405\n",
      "Epoch   9 Batch   53/78 - Train Accuracy:  0.859, Validation Accuracy:  0.879, Loss:  0.433\n",
      "Epoch   9 Batch   54/78 - Train Accuracy:  0.863, Validation Accuracy:  0.885, Loss:  0.444\n",
      "Epoch   9 Batch   55/78 - Train Accuracy:  0.860, Validation Accuracy:  0.884, Loss:  0.466\n",
      "Epoch   9 Batch   56/78 - Train Accuracy:  0.869, Validation Accuracy:  0.877, Loss:  0.414\n",
      "Epoch   9 Batch   57/78 - Train Accuracy:  0.859, Validation Accuracy:  0.881, Loss:  0.466\n",
      "Epoch   9 Batch   58/78 - Train Accuracy:  0.857, Validation Accuracy:  0.877, Loss:  0.481\n",
      "Epoch   9 Batch   59/78 - Train Accuracy:  0.847, Validation Accuracy:  0.878, Loss:  0.455\n",
      "Epoch   9 Batch   60/78 - Train Accuracy:  0.886, Validation Accuracy:  0.879, Loss:  0.390\n",
      "Epoch   9 Batch   61/78 - Train Accuracy:  0.868, Validation Accuracy:  0.876, Loss:  0.453\n",
      "Epoch   9 Batch   62/78 - Train Accuracy:  0.872, Validation Accuracy:  0.885, Loss:  0.427\n",
      "Epoch   9 Batch   63/78 - Train Accuracy:  0.863, Validation Accuracy:  0.883, Loss:  0.395\n",
      "Epoch   9 Batch   64/78 - Train Accuracy:  0.863, Validation Accuracy:  0.886, Loss:  0.433\n",
      "Epoch   9 Batch   65/78 - Train Accuracy:  0.856, Validation Accuracy:  0.882, Loss:  0.419\n",
      "Epoch   9 Batch   66/78 - Train Accuracy:  0.884, Validation Accuracy:  0.879, Loss:  0.379\n",
      "Epoch   9 Batch   67/78 - Train Accuracy:  0.882, Validation Accuracy:  0.876, Loss:  0.404\n",
      "Epoch   9 Batch   68/78 - Train Accuracy:  0.852, Validation Accuracy:  0.874, Loss:  0.452\n",
      "Epoch   9 Batch   69/78 - Train Accuracy:  0.885, Validation Accuracy:  0.878, Loss:  0.353\n",
      "Epoch   9 Batch   70/78 - Train Accuracy:  0.865, Validation Accuracy:  0.875, Loss:  0.434\n",
      "Epoch   9 Batch   71/78 - Train Accuracy:  0.885, Validation Accuracy:  0.876, Loss:  0.372\n",
      "Epoch   9 Batch   72/78 - Train Accuracy:  0.848, Validation Accuracy:  0.876, Loss:  0.433\n",
      "Epoch   9 Batch   73/78 - Train Accuracy:  0.844, Validation Accuracy:  0.879, Loss:  0.480\n",
      "Epoch   9 Batch   74/78 - Train Accuracy:  0.867, Validation Accuracy:  0.882, Loss:  0.426\n",
      "Epoch   9 Batch   75/78 - Train Accuracy:  0.865, Validation Accuracy:  0.876, Loss:  0.415\n",
      "Epoch   9 Batch   76/78 - Train Accuracy:  0.874, Validation Accuracy:  0.875, Loss:  0.415\n",
      "Epoch  10 Batch    0/78 - Train Accuracy:  0.864, Validation Accuracy:  0.874, Loss:  0.425\n",
      "Epoch  10 Batch    1/78 - Train Accuracy:  0.883, Validation Accuracy:  0.876, Loss:  0.397\n",
      "Epoch  10 Batch    2/78 - Train Accuracy:  0.885, Validation Accuracy:  0.869, Loss:  0.377\n",
      "Epoch  10 Batch    3/78 - Train Accuracy:  0.864, Validation Accuracy:  0.871, Loss:  0.413\n",
      "Epoch  10 Batch    4/78 - Train Accuracy:  0.868, Validation Accuracy:  0.875, Loss:  0.392\n",
      "Epoch  10 Batch    5/78 - Train Accuracy:  0.884, Validation Accuracy:  0.882, Loss:  0.381\n",
      "Epoch  10 Batch    6/78 - Train Accuracy:  0.875, Validation Accuracy:  0.878, Loss:  0.397\n",
      "Epoch  10 Batch    7/78 - Train Accuracy:  0.878, Validation Accuracy:  0.879, Loss:  0.400\n",
      "Epoch  10 Batch    8/78 - Train Accuracy:  0.885, Validation Accuracy:  0.877, Loss:  0.396\n",
      "Epoch  10 Batch    9/78 - Train Accuracy:  0.890, Validation Accuracy:  0.876, Loss:  0.370\n",
      "Epoch  10 Batch   10/78 - Train Accuracy:  0.878, Validation Accuracy:  0.879, Loss:  0.402\n",
      "Epoch  10 Batch   11/78 - Train Accuracy:  0.856, Validation Accuracy:  0.878, Loss:  0.447\n",
      "Epoch  10 Batch   12/78 - Train Accuracy:  0.865, Validation Accuracy:  0.877, Loss:  0.437\n",
      "Epoch  10 Batch   13/78 - Train Accuracy:  0.867, Validation Accuracy:  0.878, Loss:  0.442\n",
      "Epoch  10 Batch   14/78 - Train Accuracy:  0.888, Validation Accuracy:  0.883, Loss:  0.344\n",
      "Epoch  10 Batch   15/78 - Train Accuracy:  0.867, Validation Accuracy:  0.883, Loss:  0.429\n",
      "Epoch  10 Batch   16/78 - Train Accuracy:  0.879, Validation Accuracy:  0.884, Loss:  0.370\n",
      "Epoch  10 Batch   17/78 - Train Accuracy:  0.878, Validation Accuracy:  0.884, Loss:  0.379\n",
      "Epoch  10 Batch   18/78 - Train Accuracy:  0.863, Validation Accuracy:  0.882, Loss:  0.417\n",
      "Epoch  10 Batch   19/78 - Train Accuracy:  0.872, Validation Accuracy:  0.887, Loss:  0.377\n",
      "Epoch  10 Batch   20/78 - Train Accuracy:  0.892, Validation Accuracy:  0.886, Loss:  0.338\n",
      "Epoch  10 Batch   21/78 - Train Accuracy:  0.866, Validation Accuracy:  0.882, Loss:  0.427\n",
      "Epoch  10 Batch   22/78 - Train Accuracy:  0.884, Validation Accuracy:  0.881, Loss:  0.411\n",
      "Epoch  10 Batch   23/78 - Train Accuracy:  0.888, Validation Accuracy:  0.878, Loss:  0.364\n",
      "Epoch  10 Batch   24/78 - Train Accuracy:  0.890, Validation Accuracy:  0.881, Loss:  0.371\n",
      "Epoch  10 Batch   25/78 - Train Accuracy:  0.863, Validation Accuracy:  0.877, Loss:  0.400\n",
      "Epoch  10 Batch   26/78 - Train Accuracy:  0.865, Validation Accuracy:  0.884, Loss:  0.428\n",
      "Epoch  10 Batch   27/78 - Train Accuracy:  0.871, Validation Accuracy:  0.888, Loss:  0.405\n",
      "Epoch  10 Batch   28/78 - Train Accuracy:  0.856, Validation Accuracy:  0.887, Loss:  0.397\n",
      "Epoch  10 Batch   29/78 - Train Accuracy:  0.868, Validation Accuracy:  0.886, Loss:  0.389\n",
      "Epoch  10 Batch   30/78 - Train Accuracy:  0.865, Validation Accuracy:  0.879, Loss:  0.400\n",
      "Epoch  10 Batch   31/78 - Train Accuracy:  0.878, Validation Accuracy:  0.884, Loss:  0.365\n",
      "Epoch  10 Batch   32/78 - Train Accuracy:  0.855, Validation Accuracy:  0.882, Loss:  0.383\n",
      "Epoch  10 Batch   33/78 - Train Accuracy:  0.864, Validation Accuracy:  0.882, Loss:  0.412\n",
      "Epoch  10 Batch   34/78 - Train Accuracy:  0.878, Validation Accuracy:  0.882, Loss:  0.390\n",
      "Epoch  10 Batch   35/78 - Train Accuracy:  0.873, Validation Accuracy:  0.883, Loss:  0.405\n",
      "Epoch  10 Batch   36/78 - Train Accuracy:  0.864, Validation Accuracy:  0.878, Loss:  0.406\n",
      "Epoch  10 Batch   37/78 - Train Accuracy:  0.876, Validation Accuracy:  0.882, Loss:  0.406\n",
      "Epoch  10 Batch   38/78 - Train Accuracy:  0.884, Validation Accuracy:  0.886, Loss:  0.381\n",
      "Epoch  10 Batch   39/78 - Train Accuracy:  0.875, Validation Accuracy:  0.885, Loss:  0.406\n",
      "Epoch  10 Batch   40/78 - Train Accuracy:  0.891, Validation Accuracy:  0.881, Loss:  0.372\n",
      "Epoch  10 Batch   41/78 - Train Accuracy:  0.854, Validation Accuracy:  0.882, Loss:  0.439\n",
      "Epoch  10 Batch   42/78 - Train Accuracy:  0.876, Validation Accuracy:  0.881, Loss:  0.383\n",
      "Epoch  10 Batch   43/78 - Train Accuracy:  0.849, Validation Accuracy:  0.881, Loss:  0.441\n",
      "Epoch  10 Batch   44/78 - Train Accuracy:  0.858, Validation Accuracy:  0.874, Loss:  0.392\n",
      "Epoch  10 Batch   45/78 - Train Accuracy:  0.873, Validation Accuracy:  0.881, Loss:  0.406\n",
      "Epoch  10 Batch   46/78 - Train Accuracy:  0.849, Validation Accuracy:  0.886, Loss:  0.423\n",
      "Epoch  10 Batch   47/78 - Train Accuracy:  0.879, Validation Accuracy:  0.885, Loss:  0.379\n",
      "Epoch  10 Batch   48/78 - Train Accuracy:  0.900, Validation Accuracy:  0.879, Loss:  0.335\n",
      "Epoch  10 Batch   49/78 - Train Accuracy:  0.874, Validation Accuracy:  0.888, Loss:  0.409\n",
      "Epoch  10 Batch   50/78 - Train Accuracy:  0.836, Validation Accuracy:  0.882, Loss:  0.467\n",
      "Epoch  10 Batch   51/78 - Train Accuracy:  0.882, Validation Accuracy:  0.886, Loss:  0.394\n",
      "Epoch  10 Batch   52/78 - Train Accuracy:  0.875, Validation Accuracy:  0.888, Loss:  0.358\n",
      "Epoch  10 Batch   53/78 - Train Accuracy:  0.875, Validation Accuracy:  0.894, Loss:  0.382\n",
      "Epoch  10 Batch   54/78 - Train Accuracy:  0.875, Validation Accuracy:  0.891, Loss:  0.397\n",
      "Epoch  10 Batch   55/78 - Train Accuracy:  0.882, Validation Accuracy:  0.888, Loss:  0.410\n",
      "Epoch  10 Batch   56/78 - Train Accuracy:  0.881, Validation Accuracy:  0.888, Loss:  0.369\n",
      "Epoch  10 Batch   57/78 - Train Accuracy:  0.874, Validation Accuracy:  0.878, Loss:  0.409\n",
      "Epoch  10 Batch   58/78 - Train Accuracy:  0.869, Validation Accuracy:  0.885, Loss:  0.427\n",
      "Epoch  10 Batch   59/78 - Train Accuracy:  0.862, Validation Accuracy:  0.883, Loss:  0.399\n",
      "Epoch  10 Batch   60/78 - Train Accuracy:  0.888, Validation Accuracy:  0.879, Loss:  0.349\n",
      "Epoch  10 Batch   61/78 - Train Accuracy:  0.873, Validation Accuracy:  0.884, Loss:  0.408\n",
      "Epoch  10 Batch   62/78 - Train Accuracy:  0.885, Validation Accuracy:  0.883, Loss:  0.382\n",
      "Epoch  10 Batch   63/78 - Train Accuracy:  0.888, Validation Accuracy:  0.893, Loss:  0.350\n",
      "Epoch  10 Batch   64/78 - Train Accuracy:  0.882, Validation Accuracy:  0.891, Loss:  0.381\n",
      "Epoch  10 Batch   65/78 - Train Accuracy:  0.876, Validation Accuracy:  0.893, Loss:  0.371\n",
      "Epoch  10 Batch   66/78 - Train Accuracy:  0.894, Validation Accuracy:  0.894, Loss:  0.331\n",
      "Epoch  10 Batch   67/78 - Train Accuracy:  0.897, Validation Accuracy:  0.894, Loss:  0.356\n",
      "Epoch  10 Batch   68/78 - Train Accuracy:  0.872, Validation Accuracy:  0.885, Loss:  0.405\n",
      "Epoch  10 Batch   69/78 - Train Accuracy:  0.895, Validation Accuracy:  0.885, Loss:  0.309\n",
      "Epoch  10 Batch   70/78 - Train Accuracy:  0.881, Validation Accuracy:  0.888, Loss:  0.385\n",
      "Epoch  10 Batch   71/78 - Train Accuracy:  0.897, Validation Accuracy:  0.884, Loss:  0.326\n",
      "Epoch  10 Batch   72/78 - Train Accuracy:  0.874, Validation Accuracy:  0.881, Loss:  0.383\n",
      "Epoch  10 Batch   73/78 - Train Accuracy:  0.865, Validation Accuracy:  0.885, Loss:  0.429\n",
      "Epoch  10 Batch   74/78 - Train Accuracy:  0.868, Validation Accuracy:  0.881, Loss:  0.381\n",
      "Epoch  10 Batch   75/78 - Train Accuracy:  0.873, Validation Accuracy:  0.884, Loss:  0.365\n",
      "Epoch  10 Batch   76/78 - Train Accuracy:  0.874, Validation Accuracy:  0.882, Loss:  0.369\n",
      "Epoch  11 Batch    0/78 - Train Accuracy:  0.876, Validation Accuracy:  0.884, Loss:  0.377\n",
      "Epoch  11 Batch    1/78 - Train Accuracy:  0.898, Validation Accuracy:  0.879, Loss:  0.349\n",
      "Epoch  11 Batch    2/78 - Train Accuracy:  0.892, Validation Accuracy:  0.877, Loss:  0.330\n",
      "Epoch  11 Batch    3/78 - Train Accuracy:  0.873, Validation Accuracy:  0.878, Loss:  0.371\n",
      "Epoch  11 Batch    4/78 - Train Accuracy:  0.879, Validation Accuracy:  0.879, Loss:  0.342\n",
      "Epoch  11 Batch    5/78 - Train Accuracy:  0.903, Validation Accuracy:  0.881, Loss:  0.337\n",
      "Epoch  11 Batch    6/78 - Train Accuracy:  0.898, Validation Accuracy:  0.885, Loss:  0.347\n",
      "Epoch  11 Batch    7/78 - Train Accuracy:  0.882, Validation Accuracy:  0.883, Loss:  0.358\n",
      "Epoch  11 Batch    8/78 - Train Accuracy:  0.895, Validation Accuracy:  0.886, Loss:  0.352\n",
      "Epoch  11 Batch    9/78 - Train Accuracy:  0.895, Validation Accuracy:  0.884, Loss:  0.327\n",
      "Epoch  11 Batch   10/78 - Train Accuracy:  0.891, Validation Accuracy:  0.883, Loss:  0.353\n",
      "Epoch  11 Batch   11/78 - Train Accuracy:  0.864, Validation Accuracy:  0.890, Loss:  0.395\n",
      "Epoch  11 Batch   12/78 - Train Accuracy:  0.871, Validation Accuracy:  0.893, Loss:  0.386\n",
      "Epoch  11 Batch   13/78 - Train Accuracy:  0.883, Validation Accuracy:  0.888, Loss:  0.389\n",
      "Epoch  11 Batch   14/78 - Train Accuracy:  0.894, Validation Accuracy:  0.891, Loss:  0.302\n",
      "Epoch  11 Batch   15/78 - Train Accuracy:  0.879, Validation Accuracy:  0.885, Loss:  0.382\n",
      "Epoch  11 Batch   16/78 - Train Accuracy:  0.890, Validation Accuracy:  0.888, Loss:  0.325\n",
      "Epoch  11 Batch   17/78 - Train Accuracy:  0.891, Validation Accuracy:  0.893, Loss:  0.336\n",
      "Epoch  11 Batch   18/78 - Train Accuracy:  0.882, Validation Accuracy:  0.888, Loss:  0.368\n",
      "Epoch  11 Batch   19/78 - Train Accuracy:  0.892, Validation Accuracy:  0.891, Loss:  0.331\n",
      "Epoch  11 Batch   20/78 - Train Accuracy:  0.906, Validation Accuracy:  0.891, Loss:  0.296\n",
      "Epoch  11 Batch   21/78 - Train Accuracy:  0.881, Validation Accuracy:  0.892, Loss:  0.376\n",
      "Epoch  11 Batch   22/78 - Train Accuracy:  0.888, Validation Accuracy:  0.894, Loss:  0.362\n",
      "Epoch  11 Batch   23/78 - Train Accuracy:  0.908, Validation Accuracy:  0.893, Loss:  0.321\n",
      "Epoch  11 Batch   24/78 - Train Accuracy:  0.901, Validation Accuracy:  0.893, Loss:  0.325\n",
      "Epoch  11 Batch   25/78 - Train Accuracy:  0.881, Validation Accuracy:  0.893, Loss:  0.350\n",
      "Epoch  11 Batch   26/78 - Train Accuracy:  0.877, Validation Accuracy:  0.895, Loss:  0.381\n",
      "Epoch  11 Batch   27/78 - Train Accuracy:  0.883, Validation Accuracy:  0.896, Loss:  0.358\n",
      "Epoch  11 Batch   28/78 - Train Accuracy:  0.875, Validation Accuracy:  0.891, Loss:  0.351\n",
      "Epoch  11 Batch   29/78 - Train Accuracy:  0.882, Validation Accuracy:  0.891, Loss:  0.346\n",
      "Epoch  11 Batch   30/78 - Train Accuracy:  0.881, Validation Accuracy:  0.890, Loss:  0.356\n",
      "Epoch  11 Batch   31/78 - Train Accuracy:  0.894, Validation Accuracy:  0.888, Loss:  0.324\n",
      "Epoch  11 Batch   32/78 - Train Accuracy:  0.875, Validation Accuracy:  0.892, Loss:  0.340\n",
      "Epoch  11 Batch   33/78 - Train Accuracy:  0.878, Validation Accuracy:  0.888, Loss:  0.366\n",
      "Epoch  11 Batch   34/78 - Train Accuracy:  0.890, Validation Accuracy:  0.888, Loss:  0.347\n",
      "Epoch  11 Batch   35/78 - Train Accuracy:  0.876, Validation Accuracy:  0.894, Loss:  0.364\n",
      "Epoch  11 Batch   36/78 - Train Accuracy:  0.893, Validation Accuracy:  0.894, Loss:  0.357\n",
      "Epoch  11 Batch   37/78 - Train Accuracy:  0.892, Validation Accuracy:  0.891, Loss:  0.361\n",
      "Epoch  11 Batch   38/78 - Train Accuracy:  0.901, Validation Accuracy:  0.892, Loss:  0.340\n",
      "Epoch  11 Batch   39/78 - Train Accuracy:  0.888, Validation Accuracy:  0.888, Loss:  0.362\n",
      "Epoch  11 Batch   40/78 - Train Accuracy:  0.900, Validation Accuracy:  0.890, Loss:  0.329\n",
      "Epoch  11 Batch   41/78 - Train Accuracy:  0.859, Validation Accuracy:  0.887, Loss:  0.403\n",
      "Epoch  11 Batch   42/78 - Train Accuracy:  0.881, Validation Accuracy:  0.884, Loss:  0.348\n",
      "Epoch  11 Batch   43/78 - Train Accuracy:  0.855, Validation Accuracy:  0.894, Loss:  0.402\n",
      "Epoch  11 Batch   44/78 - Train Accuracy:  0.869, Validation Accuracy:  0.886, Loss:  0.352\n",
      "Epoch  11 Batch   45/78 - Train Accuracy:  0.879, Validation Accuracy:  0.892, Loss:  0.377\n",
      "Epoch  11 Batch   46/78 - Train Accuracy:  0.873, Validation Accuracy:  0.890, Loss:  0.378\n",
      "Epoch  11 Batch   47/78 - Train Accuracy:  0.890, Validation Accuracy:  0.895, Loss:  0.352\n",
      "Epoch  11 Batch   48/78 - Train Accuracy:  0.905, Validation Accuracy:  0.884, Loss:  0.295\n",
      "Epoch  11 Batch   49/78 - Train Accuracy:  0.886, Validation Accuracy:  0.888, Loss:  0.372\n",
      "Epoch  11 Batch   50/78 - Train Accuracy:  0.845, Validation Accuracy:  0.886, Loss:  0.421\n",
      "Epoch  11 Batch   51/78 - Train Accuracy:  0.894, Validation Accuracy:  0.896, Loss:  0.355\n",
      "Epoch  11 Batch   52/78 - Train Accuracy:  0.895, Validation Accuracy:  0.901, Loss:  0.323\n",
      "Epoch  11 Batch   53/78 - Train Accuracy:  0.882, Validation Accuracy:  0.901, Loss:  0.334\n",
      "Epoch  11 Batch   54/78 - Train Accuracy:  0.875, Validation Accuracy:  0.903, Loss:  0.363\n",
      "Epoch  11 Batch   55/78 - Train Accuracy:  0.881, Validation Accuracy:  0.894, Loss:  0.361\n",
      "Epoch  11 Batch   56/78 - Train Accuracy:  0.900, Validation Accuracy:  0.895, Loss:  0.338\n",
      "Epoch  11 Batch   57/78 - Train Accuracy:  0.885, Validation Accuracy:  0.898, Loss:  0.362\n",
      "Epoch  11 Batch   58/78 - Train Accuracy:  0.878, Validation Accuracy:  0.897, Loss:  0.383\n",
      "Epoch  11 Batch   59/78 - Train Accuracy:  0.884, Validation Accuracy:  0.891, Loss:  0.359\n",
      "Epoch  11 Batch   60/78 - Train Accuracy:  0.893, Validation Accuracy:  0.896, Loss:  0.313\n",
      "Epoch  11 Batch   61/78 - Train Accuracy:  0.881, Validation Accuracy:  0.891, Loss:  0.377\n",
      "Epoch  11 Batch   62/78 - Train Accuracy:  0.881, Validation Accuracy:  0.887, Loss:  0.337\n",
      "Epoch  11 Batch   63/78 - Train Accuracy:  0.888, Validation Accuracy:  0.897, Loss:  0.316\n",
      "Epoch  11 Batch   64/78 - Train Accuracy:  0.893, Validation Accuracy:  0.897, Loss:  0.339\n",
      "Epoch  11 Batch   65/78 - Train Accuracy:  0.888, Validation Accuracy:  0.895, Loss:  0.331\n",
      "Epoch  11 Batch   66/78 - Train Accuracy:  0.903, Validation Accuracy:  0.900, Loss:  0.301\n",
      "Epoch  11 Batch   67/78 - Train Accuracy:  0.895, Validation Accuracy:  0.897, Loss:  0.318\n",
      "Epoch  11 Batch   68/78 - Train Accuracy:  0.876, Validation Accuracy:  0.900, Loss:  0.369\n",
      "Epoch  11 Batch   69/78 - Train Accuracy:  0.908, Validation Accuracy:  0.892, Loss:  0.276\n",
      "Epoch  11 Batch   70/78 - Train Accuracy:  0.895, Validation Accuracy:  0.893, Loss:  0.342\n",
      "Epoch  11 Batch   71/78 - Train Accuracy:  0.908, Validation Accuracy:  0.888, Loss:  0.293\n",
      "Epoch  11 Batch   72/78 - Train Accuracy:  0.877, Validation Accuracy:  0.884, Loss:  0.339\n",
      "Epoch  11 Batch   73/78 - Train Accuracy:  0.871, Validation Accuracy:  0.886, Loss:  0.387\n",
      "Epoch  11 Batch   74/78 - Train Accuracy:  0.878, Validation Accuracy:  0.892, Loss:  0.342\n",
      "Epoch  11 Batch   75/78 - Train Accuracy:  0.881, Validation Accuracy:  0.891, Loss:  0.327\n",
      "Epoch  11 Batch   76/78 - Train Accuracy:  0.883, Validation Accuracy:  0.891, Loss:  0.335\n",
      "Epoch  12 Batch    0/78 - Train Accuracy:  0.871, Validation Accuracy:  0.895, Loss:  0.336\n",
      "Epoch  12 Batch    1/78 - Train Accuracy:  0.901, Validation Accuracy:  0.897, Loss:  0.315\n",
      "Epoch  12 Batch    2/78 - Train Accuracy:  0.895, Validation Accuracy:  0.892, Loss:  0.293\n",
      "Epoch  12 Batch    3/78 - Train Accuracy:  0.882, Validation Accuracy:  0.890, Loss:  0.334\n",
      "Epoch  12 Batch    4/78 - Train Accuracy:  0.901, Validation Accuracy:  0.895, Loss:  0.304\n",
      "Epoch  12 Batch    5/78 - Train Accuracy:  0.905, Validation Accuracy:  0.892, Loss:  0.301\n",
      "Epoch  12 Batch    6/78 - Train Accuracy:  0.904, Validation Accuracy:  0.890, Loss:  0.315\n",
      "Epoch  12 Batch    7/78 - Train Accuracy:  0.894, Validation Accuracy:  0.890, Loss:  0.325\n",
      "Epoch  12 Batch    8/78 - Train Accuracy:  0.901, Validation Accuracy:  0.897, Loss:  0.317\n",
      "Epoch  12 Batch    9/78 - Train Accuracy:  0.904, Validation Accuracy:  0.898, Loss:  0.294\n",
      "Epoch  12 Batch   10/78 - Train Accuracy:  0.892, Validation Accuracy:  0.897, Loss:  0.314\n",
      "Epoch  12 Batch   11/78 - Train Accuracy:  0.873, Validation Accuracy:  0.898, Loss:  0.356\n",
      "Epoch  12 Batch   12/78 - Train Accuracy:  0.879, Validation Accuracy:  0.901, Loss:  0.343\n",
      "Epoch  12 Batch   13/78 - Train Accuracy:  0.885, Validation Accuracy:  0.897, Loss:  0.347\n",
      "Epoch  12 Batch   14/78 - Train Accuracy:  0.912, Validation Accuracy:  0.898, Loss:  0.271\n",
      "Epoch  12 Batch   15/78 - Train Accuracy:  0.888, Validation Accuracy:  0.901, Loss:  0.344\n",
      "Epoch  12 Batch   16/78 - Train Accuracy:  0.900, Validation Accuracy:  0.892, Loss:  0.291\n",
      "Epoch  12 Batch   17/78 - Train Accuracy:  0.897, Validation Accuracy:  0.892, Loss:  0.300\n",
      "Epoch  12 Batch   18/78 - Train Accuracy:  0.894, Validation Accuracy:  0.894, Loss:  0.328\n",
      "Epoch  12 Batch   19/78 - Train Accuracy:  0.905, Validation Accuracy:  0.905, Loss:  0.298\n",
      "Epoch  12 Batch   20/78 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  0.261\n",
      "Epoch  12 Batch   21/78 - Train Accuracy:  0.882, Validation Accuracy:  0.901, Loss:  0.333\n",
      "Epoch  12 Batch   22/78 - Train Accuracy:  0.898, Validation Accuracy:  0.904, Loss:  0.324\n",
      "Epoch  12 Batch   23/78 - Train Accuracy:  0.914, Validation Accuracy:  0.904, Loss:  0.285\n",
      "Epoch  12 Batch   24/78 - Train Accuracy:  0.914, Validation Accuracy:  0.903, Loss:  0.288\n",
      "Epoch  12 Batch   25/78 - Train Accuracy:  0.897, Validation Accuracy:  0.900, Loss:  0.308\n",
      "Epoch  12 Batch   26/78 - Train Accuracy:  0.879, Validation Accuracy:  0.902, Loss:  0.343\n",
      "Epoch  12 Batch   27/78 - Train Accuracy:  0.903, Validation Accuracy:  0.902, Loss:  0.316\n",
      "Epoch  12 Batch   28/78 - Train Accuracy:  0.887, Validation Accuracy:  0.902, Loss:  0.313\n",
      "Epoch  12 Batch   29/78 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  0.312\n",
      "Epoch  12 Batch   30/78 - Train Accuracy:  0.897, Validation Accuracy:  0.904, Loss:  0.317\n",
      "Epoch  12 Batch   31/78 - Train Accuracy:  0.906, Validation Accuracy:  0.902, Loss:  0.293\n",
      "Epoch  12 Batch   32/78 - Train Accuracy:  0.894, Validation Accuracy:  0.897, Loss:  0.303\n",
      "Epoch  12 Batch   33/78 - Train Accuracy:  0.888, Validation Accuracy:  0.901, Loss:  0.329\n",
      "Epoch  12 Batch   34/78 - Train Accuracy:  0.898, Validation Accuracy:  0.901, Loss:  0.311\n",
      "Epoch  12 Batch   35/78 - Train Accuracy:  0.896, Validation Accuracy:  0.897, Loss:  0.325\n",
      "Epoch  12 Batch   36/78 - Train Accuracy:  0.890, Validation Accuracy:  0.903, Loss:  0.320\n",
      "Epoch  12 Batch   37/78 - Train Accuracy:  0.898, Validation Accuracy:  0.902, Loss:  0.320\n",
      "Epoch  12 Batch   38/78 - Train Accuracy:  0.907, Validation Accuracy:  0.901, Loss:  0.309\n",
      "Epoch  12 Batch   39/78 - Train Accuracy:  0.894, Validation Accuracy:  0.894, Loss:  0.329\n",
      "Epoch  12 Batch   40/78 - Train Accuracy:  0.908, Validation Accuracy:  0.887, Loss:  0.293\n",
      "Epoch  12 Batch   41/78 - Train Accuracy:  0.874, Validation Accuracy:  0.901, Loss:  0.384\n",
      "Epoch  12 Batch   42/78 - Train Accuracy:  0.876, Validation Accuracy:  0.886, Loss:  0.311\n",
      "Epoch  12 Batch   43/78 - Train Accuracy:  0.866, Validation Accuracy:  0.902, Loss:  0.376\n",
      "Epoch  12 Batch   44/78 - Train Accuracy:  0.882, Validation Accuracy:  0.893, Loss:  0.313\n",
      "Epoch  12 Batch   45/78 - Train Accuracy:  0.876, Validation Accuracy:  0.900, Loss:  0.345\n",
      "Epoch  12 Batch   46/78 - Train Accuracy:  0.881, Validation Accuracy:  0.895, Loss:  0.342\n",
      "Epoch  12 Batch   47/78 - Train Accuracy:  0.893, Validation Accuracy:  0.894, Loss:  0.311\n",
      "Epoch  12 Batch   48/78 - Train Accuracy:  0.916, Validation Accuracy:  0.893, Loss:  0.264\n",
      "Epoch  12 Batch   49/78 - Train Accuracy:  0.888, Validation Accuracy:  0.901, Loss:  0.317\n",
      "Epoch  12 Batch   50/78 - Train Accuracy:  0.867, Validation Accuracy:  0.894, Loss:  0.379\n",
      "Epoch  12 Batch   51/78 - Train Accuracy:  0.904, Validation Accuracy:  0.900, Loss:  0.307\n",
      "Epoch  12 Batch   52/78 - Train Accuracy:  0.905, Validation Accuracy:  0.897, Loss:  0.286\n",
      "Epoch  12 Batch   53/78 - Train Accuracy:  0.901, Validation Accuracy:  0.898, Loss:  0.298\n",
      "Epoch  12 Batch   54/78 - Train Accuracy:  0.885, Validation Accuracy:  0.904, Loss:  0.316\n",
      "Epoch  12 Batch   55/78 - Train Accuracy:  0.893, Validation Accuracy:  0.908, Loss:  0.328\n",
      "Epoch  12 Batch   56/78 - Train Accuracy:  0.907, Validation Accuracy:  0.901, Loss:  0.293\n",
      "Epoch  12 Batch   57/78 - Train Accuracy:  0.895, Validation Accuracy:  0.900, Loss:  0.330\n",
      "Epoch  12 Batch   58/78 - Train Accuracy:  0.890, Validation Accuracy:  0.896, Loss:  0.344\n",
      "Epoch  12 Batch   59/78 - Train Accuracy:  0.893, Validation Accuracy:  0.890, Loss:  0.317\n",
      "Epoch  12 Batch   60/78 - Train Accuracy:  0.904, Validation Accuracy:  0.891, Loss:  0.285\n",
      "Epoch  12 Batch   61/78 - Train Accuracy:  0.895, Validation Accuracy:  0.902, Loss:  0.327\n",
      "Epoch  12 Batch   62/78 - Train Accuracy:  0.895, Validation Accuracy:  0.906, Loss:  0.303\n",
      "Epoch  12 Batch   63/78 - Train Accuracy:  0.900, Validation Accuracy:  0.910, Loss:  0.275\n",
      "Epoch  12 Batch   64/78 - Train Accuracy:  0.894, Validation Accuracy:  0.910, Loss:  0.299\n",
      "Epoch  12 Batch   65/78 - Train Accuracy:  0.895, Validation Accuracy:  0.905, Loss:  0.292\n",
      "Epoch  12 Batch   66/78 - Train Accuracy:  0.908, Validation Accuracy:  0.897, Loss:  0.265\n",
      "Epoch  12 Batch   67/78 - Train Accuracy:  0.904, Validation Accuracy:  0.897, Loss:  0.286\n",
      "Epoch  12 Batch   68/78 - Train Accuracy:  0.890, Validation Accuracy:  0.896, Loss:  0.328\n",
      "Epoch  12 Batch   69/78 - Train Accuracy:  0.920, Validation Accuracy:  0.892, Loss:  0.245\n",
      "Epoch  12 Batch   70/78 - Train Accuracy:  0.904, Validation Accuracy:  0.894, Loss:  0.302\n",
      "Epoch  12 Batch   71/78 - Train Accuracy:  0.923, Validation Accuracy:  0.893, Loss:  0.259\n",
      "Epoch  12 Batch   72/78 - Train Accuracy:  0.884, Validation Accuracy:  0.900, Loss:  0.304\n",
      "Epoch  12 Batch   73/78 - Train Accuracy:  0.888, Validation Accuracy:  0.902, Loss:  0.340\n",
      "Epoch  12 Batch   74/78 - Train Accuracy:  0.886, Validation Accuracy:  0.894, Loss:  0.307\n",
      "Epoch  12 Batch   75/78 - Train Accuracy:  0.893, Validation Accuracy:  0.898, Loss:  0.286\n",
      "Epoch  12 Batch   76/78 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  0.300\n",
      "Epoch  13 Batch    0/78 - Train Accuracy:  0.886, Validation Accuracy:  0.898, Loss:  0.297\n",
      "Epoch  13 Batch    1/78 - Train Accuracy:  0.905, Validation Accuracy:  0.897, Loss:  0.274\n",
      "Epoch  13 Batch    2/78 - Train Accuracy:  0.908, Validation Accuracy:  0.894, Loss:  0.259\n",
      "Epoch  13 Batch    3/78 - Train Accuracy:  0.898, Validation Accuracy:  0.894, Loss:  0.294\n",
      "Epoch  13 Batch    4/78 - Train Accuracy:  0.912, Validation Accuracy:  0.898, Loss:  0.262\n",
      "Epoch  13 Batch    5/78 - Train Accuracy:  0.915, Validation Accuracy:  0.892, Loss:  0.270\n",
      "Epoch  13 Batch    6/78 - Train Accuracy:  0.913, Validation Accuracy:  0.895, Loss:  0.273\n",
      "Epoch  13 Batch    7/78 - Train Accuracy:  0.896, Validation Accuracy:  0.898, Loss:  0.291\n",
      "Epoch  13 Batch    8/78 - Train Accuracy:  0.913, Validation Accuracy:  0.902, Loss:  0.284\n",
      "Epoch  13 Batch    9/78 - Train Accuracy:  0.923, Validation Accuracy:  0.901, Loss:  0.264\n",
      "Epoch  13 Batch   10/78 - Train Accuracy:  0.897, Validation Accuracy:  0.903, Loss:  0.283\n",
      "Epoch  13 Batch   11/78 - Train Accuracy:  0.886, Validation Accuracy:  0.898, Loss:  0.313\n",
      "Epoch  13 Batch   12/78 - Train Accuracy:  0.895, Validation Accuracy:  0.903, Loss:  0.310\n",
      "Epoch  13 Batch   13/78 - Train Accuracy:  0.891, Validation Accuracy:  0.906, Loss:  0.302\n",
      "Epoch  13 Batch   14/78 - Train Accuracy:  0.911, Validation Accuracy:  0.901, Loss:  0.240\n",
      "Epoch  13 Batch   15/78 - Train Accuracy:  0.894, Validation Accuracy:  0.903, Loss:  0.314\n",
      "Epoch  13 Batch   16/78 - Train Accuracy:  0.908, Validation Accuracy:  0.900, Loss:  0.257\n",
      "Epoch  13 Batch   17/78 - Train Accuracy:  0.907, Validation Accuracy:  0.904, Loss:  0.270\n",
      "Epoch  13 Batch   18/78 - Train Accuracy:  0.906, Validation Accuracy:  0.903, Loss:  0.296\n",
      "Epoch  13 Batch   19/78 - Train Accuracy:  0.913, Validation Accuracy:  0.897, Loss:  0.265\n",
      "Epoch  13 Batch   20/78 - Train Accuracy:  0.930, Validation Accuracy:  0.902, Loss:  0.233\n",
      "Epoch  13 Batch   21/78 - Train Accuracy:  0.896, Validation Accuracy:  0.904, Loss:  0.295\n",
      "Epoch  13 Batch   22/78 - Train Accuracy:  0.907, Validation Accuracy:  0.902, Loss:  0.292\n",
      "Epoch  13 Batch   23/78 - Train Accuracy:  0.916, Validation Accuracy:  0.902, Loss:  0.250\n",
      "Epoch  13 Batch   24/78 - Train Accuracy:  0.922, Validation Accuracy:  0.903, Loss:  0.253\n",
      "Epoch  13 Batch   25/78 - Train Accuracy:  0.904, Validation Accuracy:  0.905, Loss:  0.276\n",
      "Epoch  13 Batch   26/78 - Train Accuracy:  0.888, Validation Accuracy:  0.905, Loss:  0.305\n",
      "Epoch  13 Batch   27/78 - Train Accuracy:  0.910, Validation Accuracy:  0.903, Loss:  0.283\n",
      "Epoch  13 Batch   28/78 - Train Accuracy:  0.896, Validation Accuracy:  0.905, Loss:  0.280\n",
      "Epoch  13 Batch   29/78 - Train Accuracy:  0.910, Validation Accuracy:  0.910, Loss:  0.284\n",
      "Epoch  13 Batch   30/78 - Train Accuracy:  0.905, Validation Accuracy:  0.912, Loss:  0.281\n",
      "Epoch  13 Batch   31/78 - Train Accuracy:  0.905, Validation Accuracy:  0.908, Loss:  0.265\n",
      "Epoch  13 Batch   32/78 - Train Accuracy:  0.908, Validation Accuracy:  0.902, Loss:  0.273\n",
      "Epoch  13 Batch   33/78 - Train Accuracy:  0.901, Validation Accuracy:  0.901, Loss:  0.294\n",
      "Epoch  13 Batch   34/78 - Train Accuracy:  0.908, Validation Accuracy:  0.904, Loss:  0.278\n",
      "Epoch  13 Batch   35/78 - Train Accuracy:  0.911, Validation Accuracy:  0.905, Loss:  0.293\n",
      "Epoch  13 Batch   36/78 - Train Accuracy:  0.906, Validation Accuracy:  0.905, Loss:  0.279\n",
      "Epoch  13 Batch   37/78 - Train Accuracy:  0.900, Validation Accuracy:  0.904, Loss:  0.288\n",
      "Epoch  13 Batch   38/78 - Train Accuracy:  0.913, Validation Accuracy:  0.905, Loss:  0.275\n",
      "Epoch  13 Batch   39/78 - Train Accuracy:  0.900, Validation Accuracy:  0.900, Loss:  0.297\n",
      "Epoch  13 Batch   40/78 - Train Accuracy:  0.915, Validation Accuracy:  0.894, Loss:  0.261\n",
      "Epoch  13 Batch   41/78 - Train Accuracy:  0.871, Validation Accuracy:  0.898, Loss:  0.343\n",
      "Epoch  13 Batch   42/78 - Train Accuracy:  0.883, Validation Accuracy:  0.890, Loss:  0.280\n",
      "Epoch  13 Batch   43/78 - Train Accuracy:  0.881, Validation Accuracy:  0.897, Loss:  0.329\n",
      "Epoch  13 Batch   44/78 - Train Accuracy:  0.886, Validation Accuracy:  0.910, Loss:  0.283\n",
      "Epoch  13 Batch   45/78 - Train Accuracy:  0.878, Validation Accuracy:  0.910, Loss:  0.302\n",
      "Epoch  13 Batch   46/78 - Train Accuracy:  0.900, Validation Accuracy:  0.898, Loss:  0.307\n",
      "Epoch  13 Batch   47/78 - Train Accuracy:  0.901, Validation Accuracy:  0.901, Loss:  0.268\n",
      "Epoch  13 Batch   48/78 - Train Accuracy:  0.927, Validation Accuracy:  0.908, Loss:  0.233\n",
      "Epoch  13 Batch   49/78 - Train Accuracy:  0.898, Validation Accuracy:  0.905, Loss:  0.281\n",
      "Epoch  13 Batch   50/78 - Train Accuracy:  0.877, Validation Accuracy:  0.908, Loss:  0.333\n",
      "Epoch  13 Batch   51/78 - Train Accuracy:  0.913, Validation Accuracy:  0.908, Loss:  0.271\n",
      "Epoch  13 Batch   52/78 - Train Accuracy:  0.919, Validation Accuracy:  0.908, Loss:  0.252\n",
      "Epoch  13 Batch   53/78 - Train Accuracy:  0.904, Validation Accuracy:  0.904, Loss:  0.262\n",
      "Epoch  13 Batch   54/78 - Train Accuracy:  0.892, Validation Accuracy:  0.902, Loss:  0.282\n",
      "Epoch  13 Batch   55/78 - Train Accuracy:  0.903, Validation Accuracy:  0.905, Loss:  0.290\n",
      "Epoch  13 Batch   56/78 - Train Accuracy:  0.921, Validation Accuracy:  0.915, Loss:  0.262\n",
      "Epoch  13 Batch   57/78 - Train Accuracy:  0.895, Validation Accuracy:  0.914, Loss:  0.294\n",
      "Epoch  13 Batch   58/78 - Train Accuracy:  0.905, Validation Accuracy:  0.908, Loss:  0.305\n",
      "Epoch  13 Batch   59/78 - Train Accuracy:  0.904, Validation Accuracy:  0.906, Loss:  0.280\n",
      "Epoch  13 Batch   60/78 - Train Accuracy:  0.910, Validation Accuracy:  0.903, Loss:  0.255\n",
      "Epoch  13 Batch   61/78 - Train Accuracy:  0.900, Validation Accuracy:  0.907, Loss:  0.293\n",
      "Epoch  13 Batch   62/78 - Train Accuracy:  0.903, Validation Accuracy:  0.912, Loss:  0.273\n",
      "Epoch  13 Batch   63/78 - Train Accuracy:  0.913, Validation Accuracy:  0.915, Loss:  0.244\n",
      "Epoch  13 Batch   64/78 - Train Accuracy:  0.910, Validation Accuracy:  0.912, Loss:  0.264\n",
      "Epoch  13 Batch   65/78 - Train Accuracy:  0.911, Validation Accuracy:  0.906, Loss:  0.258\n",
      "Epoch  13 Batch   66/78 - Train Accuracy:  0.914, Validation Accuracy:  0.906, Loss:  0.238\n",
      "Epoch  13 Batch   67/78 - Train Accuracy:  0.914, Validation Accuracy:  0.913, Loss:  0.256\n",
      "Epoch  13 Batch   68/78 - Train Accuracy:  0.906, Validation Accuracy:  0.910, Loss:  0.291\n",
      "Epoch  13 Batch   69/78 - Train Accuracy:  0.922, Validation Accuracy:  0.906, Loss:  0.221\n",
      "Epoch  13 Batch   70/78 - Train Accuracy:  0.906, Validation Accuracy:  0.897, Loss:  0.269\n",
      "Epoch  13 Batch   71/78 - Train Accuracy:  0.920, Validation Accuracy:  0.901, Loss:  0.230\n",
      "Epoch  13 Batch   72/78 - Train Accuracy:  0.893, Validation Accuracy:  0.900, Loss:  0.273\n",
      "Epoch  13 Batch   73/78 - Train Accuracy:  0.906, Validation Accuracy:  0.897, Loss:  0.300\n",
      "Epoch  13 Batch   74/78 - Train Accuracy:  0.894, Validation Accuracy:  0.897, Loss:  0.278\n",
      "Epoch  13 Batch   75/78 - Train Accuracy:  0.902, Validation Accuracy:  0.897, Loss:  0.255\n",
      "Epoch  13 Batch   76/78 - Train Accuracy:  0.897, Validation Accuracy:  0.902, Loss:  0.267\n",
      "Epoch  14 Batch    0/78 - Train Accuracy:  0.902, Validation Accuracy:  0.903, Loss:  0.268\n",
      "Epoch  14 Batch    1/78 - Train Accuracy:  0.906, Validation Accuracy:  0.904, Loss:  0.244\n",
      "Epoch  14 Batch    2/78 - Train Accuracy:  0.913, Validation Accuracy:  0.902, Loss:  0.227\n",
      "Epoch  14 Batch    3/78 - Train Accuracy:  0.907, Validation Accuracy:  0.898, Loss:  0.263\n",
      "Epoch  14 Batch    4/78 - Train Accuracy:  0.919, Validation Accuracy:  0.904, Loss:  0.231\n",
      "Epoch  14 Batch    5/78 - Train Accuracy:  0.925, Validation Accuracy:  0.902, Loss:  0.241\n",
      "Epoch  14 Batch    6/78 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  0.244\n",
      "Epoch  14 Batch    7/78 - Train Accuracy:  0.896, Validation Accuracy:  0.904, Loss:  0.264\n",
      "Epoch  14 Batch    8/78 - Train Accuracy:  0.921, Validation Accuracy:  0.913, Loss:  0.252\n",
      "Epoch  14 Batch    9/78 - Train Accuracy:  0.925, Validation Accuracy:  0.913, Loss:  0.239\n",
      "Epoch  14 Batch   10/78 - Train Accuracy:  0.914, Validation Accuracy:  0.910, Loss:  0.246\n",
      "Epoch  14 Batch   11/78 - Train Accuracy:  0.902, Validation Accuracy:  0.908, Loss:  0.280\n",
      "Epoch  14 Batch   12/78 - Train Accuracy:  0.900, Validation Accuracy:  0.910, Loss:  0.274\n",
      "Epoch  14 Batch   13/78 - Train Accuracy:  0.890, Validation Accuracy:  0.914, Loss:  0.268\n",
      "Epoch  14 Batch   14/78 - Train Accuracy:  0.924, Validation Accuracy:  0.915, Loss:  0.210\n",
      "Epoch  14 Batch   15/78 - Train Accuracy:  0.906, Validation Accuracy:  0.912, Loss:  0.281\n",
      "Epoch  14 Batch   16/78 - Train Accuracy:  0.917, Validation Accuracy:  0.904, Loss:  0.228\n",
      "Epoch  14 Batch   17/78 - Train Accuracy:  0.907, Validation Accuracy:  0.905, Loss:  0.241\n",
      "Epoch  14 Batch   18/78 - Train Accuracy:  0.915, Validation Accuracy:  0.911, Loss:  0.265\n",
      "Epoch  14 Batch   19/78 - Train Accuracy:  0.924, Validation Accuracy:  0.911, Loss:  0.236\n",
      "Epoch  14 Batch   20/78 - Train Accuracy:  0.935, Validation Accuracy:  0.913, Loss:  0.203\n",
      "Epoch  14 Batch   21/78 - Train Accuracy:  0.908, Validation Accuracy:  0.912, Loss:  0.264\n",
      "Epoch  14 Batch   22/78 - Train Accuracy:  0.908, Validation Accuracy:  0.911, Loss:  0.257\n",
      "Epoch  14 Batch   23/78 - Train Accuracy:  0.922, Validation Accuracy:  0.908, Loss:  0.224\n",
      "Epoch  14 Batch   24/78 - Train Accuracy:  0.929, Validation Accuracy:  0.907, Loss:  0.224\n",
      "Epoch  14 Batch   25/78 - Train Accuracy:  0.910, Validation Accuracy:  0.904, Loss:  0.244\n",
      "Epoch  14 Batch   26/78 - Train Accuracy:  0.898, Validation Accuracy:  0.903, Loss:  0.273\n",
      "Epoch  14 Batch   27/78 - Train Accuracy:  0.910, Validation Accuracy:  0.905, Loss:  0.254\n",
      "Epoch  14 Batch   28/78 - Train Accuracy:  0.900, Validation Accuracy:  0.908, Loss:  0.250\n",
      "Epoch  14 Batch   29/78 - Train Accuracy:  0.916, Validation Accuracy:  0.912, Loss:  0.259\n",
      "Epoch  14 Batch   30/78 - Train Accuracy:  0.910, Validation Accuracy:  0.906, Loss:  0.249\n",
      "Epoch  14 Batch   31/78 - Train Accuracy:  0.913, Validation Accuracy:  0.903, Loss:  0.241\n",
      "Epoch  14 Batch   32/78 - Train Accuracy:  0.917, Validation Accuracy:  0.910, Loss:  0.246\n",
      "Epoch  14 Batch   33/78 - Train Accuracy:  0.903, Validation Accuracy:  0.908, Loss:  0.263\n",
      "Epoch  14 Batch   34/78 - Train Accuracy:  0.914, Validation Accuracy:  0.902, Loss:  0.247\n",
      "Epoch  14 Batch   35/78 - Train Accuracy:  0.902, Validation Accuracy:  0.906, Loss:  0.263\n",
      "Epoch  14 Batch   36/78 - Train Accuracy:  0.912, Validation Accuracy:  0.904, Loss:  0.247\n",
      "Epoch  14 Batch   37/78 - Train Accuracy:  0.905, Validation Accuracy:  0.904, Loss:  0.261\n",
      "Epoch  14 Batch   38/78 - Train Accuracy:  0.915, Validation Accuracy:  0.910, Loss:  0.246\n",
      "Epoch  14 Batch   39/78 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  0.265\n",
      "Epoch  14 Batch   40/78 - Train Accuracy:  0.925, Validation Accuracy:  0.904, Loss:  0.235\n",
      "Epoch  14 Batch   41/78 - Train Accuracy:  0.881, Validation Accuracy:  0.903, Loss:  0.305\n",
      "Epoch  14 Batch   42/78 - Train Accuracy:  0.890, Validation Accuracy:  0.904, Loss:  0.252\n",
      "Epoch  14 Batch   43/78 - Train Accuracy:  0.883, Validation Accuracy:  0.911, Loss:  0.294\n",
      "Epoch  14 Batch   44/78 - Train Accuracy:  0.891, Validation Accuracy:  0.915, Loss:  0.255\n",
      "Epoch  14 Batch   45/78 - Train Accuracy:  0.878, Validation Accuracy:  0.911, Loss:  0.272\n",
      "Epoch  14 Batch   46/78 - Train Accuracy:  0.905, Validation Accuracy:  0.907, Loss:  0.272\n",
      "Epoch  14 Batch   47/78 - Train Accuracy:  0.908, Validation Accuracy:  0.910, Loss:  0.238\n",
      "Epoch  14 Batch   48/78 - Train Accuracy:  0.938, Validation Accuracy:  0.921, Loss:  0.208\n",
      "Epoch  14 Batch   49/78 - Train Accuracy:  0.914, Validation Accuracy:  0.919, Loss:  0.252\n",
      "Epoch  14 Batch   50/78 - Train Accuracy:  0.878, Validation Accuracy:  0.917, Loss:  0.295\n",
      "Epoch  14 Batch   51/78 - Train Accuracy:  0.925, Validation Accuracy:  0.911, Loss:  0.241\n",
      "Epoch  14 Batch   52/78 - Train Accuracy:  0.920, Validation Accuracy:  0.912, Loss:  0.223\n",
      "Epoch  14 Batch   53/78 - Train Accuracy:  0.903, Validation Accuracy:  0.913, Loss:  0.231\n",
      "Epoch  14 Batch   54/78 - Train Accuracy:  0.896, Validation Accuracy:  0.915, Loss:  0.255\n",
      "Epoch  14 Batch   55/78 - Train Accuracy:  0.915, Validation Accuracy:  0.917, Loss:  0.260\n",
      "Epoch  14 Batch   56/78 - Train Accuracy:  0.924, Validation Accuracy:  0.914, Loss:  0.235\n",
      "Epoch  14 Batch   57/78 - Train Accuracy:  0.902, Validation Accuracy:  0.916, Loss:  0.266\n",
      "Epoch  14 Batch   58/78 - Train Accuracy:  0.908, Validation Accuracy:  0.914, Loss:  0.272\n",
      "Epoch  14 Batch   59/78 - Train Accuracy:  0.904, Validation Accuracy:  0.917, Loss:  0.250\n",
      "Epoch  14 Batch   60/78 - Train Accuracy:  0.904, Validation Accuracy:  0.920, Loss:  0.230\n",
      "Epoch  14 Batch   61/78 - Train Accuracy:  0.910, Validation Accuracy:  0.921, Loss:  0.263\n",
      "Epoch  14 Batch   62/78 - Train Accuracy:  0.912, Validation Accuracy:  0.924, Loss:  0.246\n",
      "Epoch  14 Batch   63/78 - Train Accuracy:  0.916, Validation Accuracy:  0.921, Loss:  0.218\n",
      "Epoch  14 Batch   64/78 - Train Accuracy:  0.919, Validation Accuracy:  0.919, Loss:  0.234\n",
      "Epoch  14 Batch   65/78 - Train Accuracy:  0.920, Validation Accuracy:  0.919, Loss:  0.230\n",
      "Epoch  14 Batch   66/78 - Train Accuracy:  0.917, Validation Accuracy:  0.923, Loss:  0.214\n",
      "Epoch  14 Batch   67/78 - Train Accuracy:  0.913, Validation Accuracy:  0.922, Loss:  0.229\n",
      "Epoch  14 Batch   68/78 - Train Accuracy:  0.907, Validation Accuracy:  0.922, Loss:  0.259\n",
      "Epoch  14 Batch   69/78 - Train Accuracy:  0.924, Validation Accuracy:  0.921, Loss:  0.200\n",
      "Epoch  14 Batch   70/78 - Train Accuracy:  0.912, Validation Accuracy:  0.917, Loss:  0.239\n",
      "Epoch  14 Batch   71/78 - Train Accuracy:  0.926, Validation Accuracy:  0.916, Loss:  0.204\n",
      "Epoch  14 Batch   72/78 - Train Accuracy:  0.904, Validation Accuracy:  0.912, Loss:  0.246\n",
      "Epoch  14 Batch   73/78 - Train Accuracy:  0.912, Validation Accuracy:  0.907, Loss:  0.265\n",
      "Epoch  14 Batch   74/78 - Train Accuracy:  0.896, Validation Accuracy:  0.911, Loss:  0.253\n",
      "Epoch  14 Batch   75/78 - Train Accuracy:  0.904, Validation Accuracy:  0.916, Loss:  0.228\n",
      "Epoch  14 Batch   76/78 - Train Accuracy:  0.907, Validation Accuracy:  0.912, Loss:  0.238\n",
      "Epoch  15 Batch    0/78 - Train Accuracy:  0.911, Validation Accuracy:  0.913, Loss:  0.240\n",
      "Epoch  15 Batch    1/78 - Train Accuracy:  0.919, Validation Accuracy:  0.917, Loss:  0.220\n",
      "Epoch  15 Batch    2/78 - Train Accuracy:  0.924, Validation Accuracy:  0.914, Loss:  0.201\n",
      "Epoch  15 Batch    3/78 - Train Accuracy:  0.915, Validation Accuracy:  0.914, Loss:  0.236\n",
      "Epoch  15 Batch    4/78 - Train Accuracy:  0.923, Validation Accuracy:  0.915, Loss:  0.204\n",
      "Epoch  15 Batch    5/78 - Train Accuracy:  0.926, Validation Accuracy:  0.910, Loss:  0.215\n",
      "Epoch  15 Batch    6/78 - Train Accuracy:  0.925, Validation Accuracy:  0.916, Loss:  0.217\n",
      "Epoch  15 Batch    7/78 - Train Accuracy:  0.902, Validation Accuracy:  0.919, Loss:  0.241\n",
      "Epoch  15 Batch    8/78 - Train Accuracy:  0.926, Validation Accuracy:  0.919, Loss:  0.224\n",
      "Epoch  15 Batch    9/78 - Train Accuracy:  0.933, Validation Accuracy:  0.920, Loss:  0.218\n",
      "Epoch  15 Batch   10/78 - Train Accuracy:  0.920, Validation Accuracy:  0.927, Loss:  0.219\n",
      "Epoch  15 Batch   11/78 - Train Accuracy:  0.908, Validation Accuracy:  0.920, Loss:  0.249\n",
      "Epoch  15 Batch   12/78 - Train Accuracy:  0.902, Validation Accuracy:  0.912, Loss:  0.247\n",
      "Epoch  15 Batch   13/78 - Train Accuracy:  0.906, Validation Accuracy:  0.913, Loss:  0.240\n",
      "Epoch  15 Batch   14/78 - Train Accuracy:  0.929, Validation Accuracy:  0.915, Loss:  0.185\n",
      "Epoch  15 Batch   15/78 - Train Accuracy:  0.908, Validation Accuracy:  0.916, Loss:  0.254\n",
      "Epoch  15 Batch   16/78 - Train Accuracy:  0.927, Validation Accuracy:  0.914, Loss:  0.204\n",
      "Epoch  15 Batch   17/78 - Train Accuracy:  0.913, Validation Accuracy:  0.914, Loss:  0.217\n",
      "Epoch  15 Batch   18/78 - Train Accuracy:  0.912, Validation Accuracy:  0.921, Loss:  0.239\n",
      "Epoch  15 Batch   19/78 - Train Accuracy:  0.924, Validation Accuracy:  0.922, Loss:  0.211\n",
      "Epoch  15 Batch   20/78 - Train Accuracy:  0.941, Validation Accuracy:  0.926, Loss:  0.180\n",
      "Epoch  15 Batch   21/78 - Train Accuracy:  0.924, Validation Accuracy:  0.919, Loss:  0.236\n",
      "Epoch  15 Batch   22/78 - Train Accuracy:  0.906, Validation Accuracy:  0.922, Loss:  0.229\n",
      "Epoch  15 Batch   23/78 - Train Accuracy:  0.929, Validation Accuracy:  0.917, Loss:  0.201\n",
      "Epoch  15 Batch   24/78 - Train Accuracy:  0.927, Validation Accuracy:  0.917, Loss:  0.200\n",
      "Epoch  15 Batch   25/78 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.219\n",
      "Epoch  15 Batch   26/78 - Train Accuracy:  0.907, Validation Accuracy:  0.925, Loss:  0.245\n",
      "Epoch  15 Batch   27/78 - Train Accuracy:  0.914, Validation Accuracy:  0.922, Loss:  0.227\n",
      "Epoch  15 Batch   28/78 - Train Accuracy:  0.908, Validation Accuracy:  0.931, Loss:  0.227\n",
      "Epoch  15 Batch   29/78 - Train Accuracy:  0.901, Validation Accuracy:  0.921, Loss:  0.236\n",
      "Epoch  15 Batch   30/78 - Train Accuracy:  0.915, Validation Accuracy:  0.920, Loss:  0.222\n",
      "Epoch  15 Batch   31/78 - Train Accuracy:  0.920, Validation Accuracy:  0.919, Loss:  0.218\n",
      "Epoch  15 Batch   32/78 - Train Accuracy:  0.925, Validation Accuracy:  0.924, Loss:  0.223\n",
      "Epoch  15 Batch   33/78 - Train Accuracy:  0.905, Validation Accuracy:  0.920, Loss:  0.236\n",
      "Epoch  15 Batch   34/78 - Train Accuracy:  0.916, Validation Accuracy:  0.916, Loss:  0.220\n",
      "Epoch  15 Batch   35/78 - Train Accuracy:  0.905, Validation Accuracy:  0.912, Loss:  0.236\n",
      "Epoch  15 Batch   36/78 - Train Accuracy:  0.924, Validation Accuracy:  0.910, Loss:  0.220\n",
      "Epoch  15 Batch   37/78 - Train Accuracy:  0.913, Validation Accuracy:  0.910, Loss:  0.235\n",
      "Epoch  15 Batch   38/78 - Train Accuracy:  0.924, Validation Accuracy:  0.916, Loss:  0.220\n",
      "Epoch  15 Batch   39/78 - Train Accuracy:  0.907, Validation Accuracy:  0.919, Loss:  0.239\n",
      "Epoch  15 Batch   40/78 - Train Accuracy:  0.932, Validation Accuracy:  0.921, Loss:  0.211\n",
      "Epoch  15 Batch   41/78 - Train Accuracy:  0.893, Validation Accuracy:  0.923, Loss:  0.272\n",
      "Epoch  15 Batch   42/78 - Train Accuracy:  0.900, Validation Accuracy:  0.914, Loss:  0.225\n",
      "Epoch  15 Batch   43/78 - Train Accuracy:  0.893, Validation Accuracy:  0.917, Loss:  0.263\n",
      "Epoch  15 Batch   44/78 - Train Accuracy:  0.900, Validation Accuracy:  0.926, Loss:  0.229\n",
      "Epoch  15 Batch   45/78 - Train Accuracy:  0.881, Validation Accuracy:  0.917, Loss:  0.242\n",
      "Epoch  15 Batch   46/78 - Train Accuracy:  0.911, Validation Accuracy:  0.922, Loss:  0.241\n",
      "Epoch  15 Batch   47/78 - Train Accuracy:  0.922, Validation Accuracy:  0.921, Loss:  0.210\n",
      "Epoch  15 Batch   48/78 - Train Accuracy:  0.940, Validation Accuracy:  0.924, Loss:  0.187\n",
      "Epoch  15 Batch   49/78 - Train Accuracy:  0.911, Validation Accuracy:  0.930, Loss:  0.227\n",
      "Epoch  15 Batch   50/78 - Train Accuracy:  0.883, Validation Accuracy:  0.930, Loss:  0.261\n",
      "Epoch  15 Batch   51/78 - Train Accuracy:  0.939, Validation Accuracy:  0.930, Loss:  0.215\n",
      "Epoch  15 Batch   52/78 - Train Accuracy:  0.929, Validation Accuracy:  0.925, Loss:  0.200\n",
      "Epoch  15 Batch   53/78 - Train Accuracy:  0.914, Validation Accuracy:  0.926, Loss:  0.205\n",
      "Epoch  15 Batch   54/78 - Train Accuracy:  0.903, Validation Accuracy:  0.926, Loss:  0.229\n",
      "Epoch  15 Batch   55/78 - Train Accuracy:  0.920, Validation Accuracy:  0.926, Loss:  0.236\n",
      "Epoch  15 Batch   56/78 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  0.211\n",
      "Epoch  15 Batch   57/78 - Train Accuracy:  0.905, Validation Accuracy:  0.920, Loss:  0.242\n",
      "Epoch  15 Batch   58/78 - Train Accuracy:  0.912, Validation Accuracy:  0.912, Loss:  0.244\n",
      "Epoch  15 Batch   59/78 - Train Accuracy:  0.910, Validation Accuracy:  0.916, Loss:  0.225\n",
      "Epoch  15 Batch   60/78 - Train Accuracy:  0.912, Validation Accuracy:  0.913, Loss:  0.208\n",
      "Epoch  15 Batch   61/78 - Train Accuracy:  0.916, Validation Accuracy:  0.915, Loss:  0.239\n",
      "Epoch  15 Batch   62/78 - Train Accuracy:  0.913, Validation Accuracy:  0.921, Loss:  0.223\n",
      "Epoch  15 Batch   63/78 - Train Accuracy:  0.919, Validation Accuracy:  0.917, Loss:  0.195\n",
      "Epoch  15 Batch   64/78 - Train Accuracy:  0.929, Validation Accuracy:  0.916, Loss:  0.208\n",
      "Epoch  15 Batch   65/78 - Train Accuracy:  0.919, Validation Accuracy:  0.923, Loss:  0.206\n",
      "Epoch  15 Batch   66/78 - Train Accuracy:  0.921, Validation Accuracy:  0.920, Loss:  0.193\n",
      "Epoch  15 Batch   67/78 - Train Accuracy:  0.916, Validation Accuracy:  0.925, Loss:  0.206\n",
      "Epoch  15 Batch   68/78 - Train Accuracy:  0.921, Validation Accuracy:  0.926, Loss:  0.232\n",
      "Epoch  15 Batch   69/78 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  0.181\n",
      "Epoch  15 Batch   70/78 - Train Accuracy:  0.920, Validation Accuracy:  0.916, Loss:  0.215\n",
      "Epoch  15 Batch   71/78 - Train Accuracy:  0.935, Validation Accuracy:  0.916, Loss:  0.180\n",
      "Epoch  15 Batch   72/78 - Train Accuracy:  0.908, Validation Accuracy:  0.919, Loss:  0.221\n",
      "Epoch  15 Batch   73/78 - Train Accuracy:  0.914, Validation Accuracy:  0.917, Loss:  0.235\n",
      "Epoch  15 Batch   74/78 - Train Accuracy:  0.913, Validation Accuracy:  0.917, Loss:  0.231\n",
      "Epoch  15 Batch   75/78 - Train Accuracy:  0.910, Validation Accuracy:  0.923, Loss:  0.204\n",
      "Epoch  15 Batch   76/78 - Train Accuracy:  0.922, Validation Accuracy:  0.921, Loss:  0.214\n",
      "Epoch  16 Batch    0/78 - Train Accuracy:  0.915, Validation Accuracy:  0.919, Loss:  0.215\n",
      "Epoch  16 Batch    1/78 - Train Accuracy:  0.929, Validation Accuracy:  0.915, Loss:  0.198\n",
      "Epoch  16 Batch    2/78 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  0.178\n",
      "Epoch  16 Batch    3/78 - Train Accuracy:  0.920, Validation Accuracy:  0.924, Loss:  0.211\n",
      "Epoch  16 Batch    4/78 - Train Accuracy:  0.930, Validation Accuracy:  0.929, Loss:  0.182\n",
      "Epoch  16 Batch    5/78 - Train Accuracy:  0.930, Validation Accuracy:  0.924, Loss:  0.192\n",
      "Epoch  16 Batch    6/78 - Train Accuracy:  0.932, Validation Accuracy:  0.924, Loss:  0.192\n",
      "Epoch  16 Batch    7/78 - Train Accuracy:  0.908, Validation Accuracy:  0.930, Loss:  0.220\n",
      "Epoch  16 Batch    8/78 - Train Accuracy:  0.936, Validation Accuracy:  0.917, Loss:  0.199\n",
      "Epoch  16 Batch    9/78 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  0.198\n",
      "Epoch  16 Batch   10/78 - Train Accuracy:  0.926, Validation Accuracy:  0.921, Loss:  0.194\n",
      "Epoch  16 Batch   11/78 - Train Accuracy:  0.919, Validation Accuracy:  0.922, Loss:  0.224\n",
      "Epoch  16 Batch   12/78 - Train Accuracy:  0.908, Validation Accuracy:  0.925, Loss:  0.223\n",
      "Epoch  16 Batch   13/78 - Train Accuracy:  0.916, Validation Accuracy:  0.926, Loss:  0.215\n",
      "Epoch  16 Batch   14/78 - Train Accuracy:  0.939, Validation Accuracy:  0.925, Loss:  0.163\n",
      "Epoch  16 Batch   15/78 - Train Accuracy:  0.913, Validation Accuracy:  0.921, Loss:  0.230\n",
      "Epoch  16 Batch   16/78 - Train Accuracy:  0.941, Validation Accuracy:  0.919, Loss:  0.184\n",
      "Epoch  16 Batch   17/78 - Train Accuracy:  0.924, Validation Accuracy:  0.924, Loss:  0.198\n",
      "Epoch  16 Batch   18/78 - Train Accuracy:  0.921, Validation Accuracy:  0.926, Loss:  0.214\n",
      "Epoch  16 Batch   19/78 - Train Accuracy:  0.932, Validation Accuracy:  0.922, Loss:  0.191\n",
      "Epoch  16 Batch   20/78 - Train Accuracy:  0.949, Validation Accuracy:  0.921, Loss:  0.159\n",
      "Epoch  16 Batch   21/78 - Train Accuracy:  0.925, Validation Accuracy:  0.921, Loss:  0.211\n",
      "Epoch  16 Batch   22/78 - Train Accuracy:  0.922, Validation Accuracy:  0.924, Loss:  0.205\n",
      "Epoch  16 Batch   23/78 - Train Accuracy:  0.932, Validation Accuracy:  0.920, Loss:  0.182\n",
      "Epoch  16 Batch   24/78 - Train Accuracy:  0.925, Validation Accuracy:  0.921, Loss:  0.180\n",
      "Epoch  16 Batch   25/78 - Train Accuracy:  0.931, Validation Accuracy:  0.930, Loss:  0.197\n",
      "Epoch  16 Batch   26/78 - Train Accuracy:  0.914, Validation Accuracy:  0.930, Loss:  0.220\n",
      "Epoch  16 Batch   27/78 - Train Accuracy:  0.927, Validation Accuracy:  0.930, Loss:  0.203\n",
      "Epoch  16 Batch   28/78 - Train Accuracy:  0.913, Validation Accuracy:  0.938, Loss:  0.206\n",
      "Epoch  16 Batch   29/78 - Train Accuracy:  0.907, Validation Accuracy:  0.932, Loss:  0.215\n",
      "Epoch  16 Batch   30/78 - Train Accuracy:  0.926, Validation Accuracy:  0.927, Loss:  0.199\n",
      "Epoch  16 Batch   31/78 - Train Accuracy:  0.925, Validation Accuracy:  0.924, Loss:  0.197\n",
      "Epoch  16 Batch   32/78 - Train Accuracy:  0.933, Validation Accuracy:  0.926, Loss:  0.202\n",
      "Epoch  16 Batch   33/78 - Train Accuracy:  0.913, Validation Accuracy:  0.921, Loss:  0.213\n",
      "Epoch  16 Batch   34/78 - Train Accuracy:  0.927, Validation Accuracy:  0.911, Loss:  0.196\n",
      "Epoch  16 Batch   35/78 - Train Accuracy:  0.900, Validation Accuracy:  0.916, Loss:  0.215\n",
      "Epoch  16 Batch   36/78 - Train Accuracy:  0.934, Validation Accuracy:  0.914, Loss:  0.200\n",
      "Epoch  16 Batch   37/78 - Train Accuracy:  0.914, Validation Accuracy:  0.913, Loss:  0.211\n",
      "Epoch  16 Batch   38/78 - Train Accuracy:  0.927, Validation Accuracy:  0.917, Loss:  0.196\n",
      "Epoch  16 Batch   39/78 - Train Accuracy:  0.919, Validation Accuracy:  0.916, Loss:  0.217\n",
      "Epoch  16 Batch   40/78 - Train Accuracy:  0.933, Validation Accuracy:  0.925, Loss:  0.190\n",
      "Epoch  16 Batch   41/78 - Train Accuracy:  0.900, Validation Accuracy:  0.929, Loss:  0.245\n",
      "Epoch  16 Batch   42/78 - Train Accuracy:  0.896, Validation Accuracy:  0.926, Loss:  0.203\n",
      "Epoch  16 Batch   43/78 - Train Accuracy:  0.903, Validation Accuracy:  0.923, Loss:  0.237\n",
      "Epoch  16 Batch   44/78 - Train Accuracy:  0.895, Validation Accuracy:  0.915, Loss:  0.204\n",
      "Epoch  16 Batch   45/78 - Train Accuracy:  0.890, Validation Accuracy:  0.924, Loss:  0.215\n",
      "Epoch  16 Batch   46/78 - Train Accuracy:  0.915, Validation Accuracy:  0.926, Loss:  0.215\n",
      "Epoch  16 Batch   47/78 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.184\n",
      "Epoch  16 Batch   48/78 - Train Accuracy:  0.946, Validation Accuracy:  0.933, Loss:  0.169\n",
      "Epoch  16 Batch   49/78 - Train Accuracy:  0.903, Validation Accuracy:  0.934, Loss:  0.206\n",
      "Epoch  16 Batch   50/78 - Train Accuracy:  0.901, Validation Accuracy:  0.932, Loss:  0.230\n",
      "Epoch  16 Batch   51/78 - Train Accuracy:  0.936, Validation Accuracy:  0.926, Loss:  0.192\n",
      "Epoch  16 Batch   52/78 - Train Accuracy:  0.938, Validation Accuracy:  0.933, Loss:  0.180\n",
      "Epoch  16 Batch   53/78 - Train Accuracy:  0.924, Validation Accuracy:  0.929, Loss:  0.183\n",
      "Epoch  16 Batch   54/78 - Train Accuracy:  0.919, Validation Accuracy:  0.933, Loss:  0.206\n",
      "Epoch  16 Batch   55/78 - Train Accuracy:  0.925, Validation Accuracy:  0.927, Loss:  0.215\n",
      "Epoch  16 Batch   56/78 - Train Accuracy:  0.939, Validation Accuracy:  0.931, Loss:  0.190\n",
      "Epoch  16 Batch   57/78 - Train Accuracy:  0.919, Validation Accuracy:  0.924, Loss:  0.217\n",
      "Epoch  16 Batch   58/78 - Train Accuracy:  0.922, Validation Accuracy:  0.915, Loss:  0.219\n",
      "Epoch  16 Batch   59/78 - Train Accuracy:  0.921, Validation Accuracy:  0.920, Loss:  0.200\n",
      "Epoch  16 Batch   60/78 - Train Accuracy:  0.917, Validation Accuracy:  0.916, Loss:  0.187\n",
      "Epoch  16 Batch   61/78 - Train Accuracy:  0.924, Validation Accuracy:  0.915, Loss:  0.215\n",
      "Epoch  16 Batch   62/78 - Train Accuracy:  0.911, Validation Accuracy:  0.917, Loss:  0.203\n",
      "Epoch  16 Batch   63/78 - Train Accuracy:  0.930, Validation Accuracy:  0.929, Loss:  0.175\n",
      "Epoch  16 Batch   64/78 - Train Accuracy:  0.932, Validation Accuracy:  0.919, Loss:  0.183\n",
      "Epoch  16 Batch   65/78 - Train Accuracy:  0.925, Validation Accuracy:  0.917, Loss:  0.187\n",
      "Epoch  16 Batch   66/78 - Train Accuracy:  0.923, Validation Accuracy:  0.925, Loss:  0.172\n",
      "Epoch  16 Batch   67/78 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.183\n",
      "Epoch  16 Batch   68/78 - Train Accuracy:  0.933, Validation Accuracy:  0.924, Loss:  0.207\n",
      "Epoch  16 Batch   69/78 - Train Accuracy:  0.948, Validation Accuracy:  0.924, Loss:  0.159\n",
      "Epoch  16 Batch   70/78 - Train Accuracy:  0.924, Validation Accuracy:  0.922, Loss:  0.192\n",
      "Epoch  16 Batch   71/78 - Train Accuracy:  0.943, Validation Accuracy:  0.913, Loss:  0.157\n",
      "Epoch  16 Batch   72/78 - Train Accuracy:  0.906, Validation Accuracy:  0.912, Loss:  0.197\n",
      "Epoch  16 Batch   73/78 - Train Accuracy:  0.913, Validation Accuracy:  0.911, Loss:  0.210\n",
      "Epoch  16 Batch   74/78 - Train Accuracy:  0.915, Validation Accuracy:  0.913, Loss:  0.206\n",
      "Epoch  16 Batch   75/78 - Train Accuracy:  0.911, Validation Accuracy:  0.922, Loss:  0.182\n",
      "Epoch  16 Batch   76/78 - Train Accuracy:  0.926, Validation Accuracy:  0.929, Loss:  0.191\n",
      "Epoch  17 Batch    0/78 - Train Accuracy:  0.923, Validation Accuracy:  0.925, Loss:  0.196\n",
      "Epoch  17 Batch    1/78 - Train Accuracy:  0.941, Validation Accuracy:  0.924, Loss:  0.171\n",
      "Epoch  17 Batch    2/78 - Train Accuracy:  0.948, Validation Accuracy:  0.922, Loss:  0.156\n",
      "Epoch  17 Batch    3/78 - Train Accuracy:  0.920, Validation Accuracy:  0.926, Loss:  0.188\n",
      "Epoch  17 Batch    4/78 - Train Accuracy:  0.942, Validation Accuracy:  0.927, Loss:  0.159\n",
      "Epoch  17 Batch    5/78 - Train Accuracy:  0.936, Validation Accuracy:  0.921, Loss:  0.172\n",
      "Epoch  17 Batch    6/78 - Train Accuracy:  0.933, Validation Accuracy:  0.923, Loss:  0.170\n",
      "Epoch  17 Batch    7/78 - Train Accuracy:  0.919, Validation Accuracy:  0.924, Loss:  0.198\n",
      "Epoch  17 Batch    8/78 - Train Accuracy:  0.942, Validation Accuracy:  0.914, Loss:  0.173\n",
      "Epoch  17 Batch    9/78 - Train Accuracy:  0.941, Validation Accuracy:  0.917, Loss:  0.178\n",
      "Epoch  17 Batch   10/78 - Train Accuracy:  0.933, Validation Accuracy:  0.926, Loss:  0.171\n",
      "Epoch  17 Batch   11/78 - Train Accuracy:  0.920, Validation Accuracy:  0.931, Loss:  0.202\n",
      "Epoch  17 Batch   12/78 - Train Accuracy:  0.925, Validation Accuracy:  0.932, Loss:  0.201\n",
      "Epoch  17 Batch   13/78 - Train Accuracy:  0.923, Validation Accuracy:  0.936, Loss:  0.194\n",
      "Epoch  17 Batch   14/78 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.144\n",
      "Epoch  17 Batch   15/78 - Train Accuracy:  0.917, Validation Accuracy:  0.929, Loss:  0.207\n",
      "Epoch  17 Batch   16/78 - Train Accuracy:  0.948, Validation Accuracy:  0.927, Loss:  0.164\n",
      "Epoch  17 Batch   17/78 - Train Accuracy:  0.924, Validation Accuracy:  0.934, Loss:  0.179\n",
      "Epoch  17 Batch   18/78 - Train Accuracy:  0.925, Validation Accuracy:  0.930, Loss:  0.192\n",
      "Epoch  17 Batch   19/78 - Train Accuracy:  0.934, Validation Accuracy:  0.926, Loss:  0.170\n",
      "Epoch  17 Batch   20/78 - Train Accuracy:  0.951, Validation Accuracy:  0.921, Loss:  0.142\n",
      "Epoch  17 Batch   21/78 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.189\n",
      "Epoch  17 Batch   22/78 - Train Accuracy:  0.929, Validation Accuracy:  0.931, Loss:  0.184\n",
      "Epoch  17 Batch   23/78 - Train Accuracy:  0.935, Validation Accuracy:  0.921, Loss:  0.168\n",
      "Epoch  17 Batch   24/78 - Train Accuracy:  0.927, Validation Accuracy:  0.921, Loss:  0.157\n",
      "Epoch  17 Batch   25/78 - Train Accuracy:  0.933, Validation Accuracy:  0.927, Loss:  0.177\n",
      "Epoch  17 Batch   26/78 - Train Accuracy:  0.914, Validation Accuracy:  0.931, Loss:  0.199\n",
      "Epoch  17 Batch   27/78 - Train Accuracy:  0.930, Validation Accuracy:  0.927, Loss:  0.183\n",
      "Epoch  17 Batch   28/78 - Train Accuracy:  0.925, Validation Accuracy:  0.926, Loss:  0.188\n",
      "Epoch  17 Batch   29/78 - Train Accuracy:  0.908, Validation Accuracy:  0.924, Loss:  0.192\n",
      "Epoch  17 Batch   30/78 - Train Accuracy:  0.938, Validation Accuracy:  0.930, Loss:  0.179\n",
      "Epoch  17 Batch   31/78 - Train Accuracy:  0.929, Validation Accuracy:  0.925, Loss:  0.177\n",
      "Epoch  17 Batch   32/78 - Train Accuracy:  0.938, Validation Accuracy:  0.919, Loss:  0.178\n",
      "Epoch  17 Batch   33/78 - Train Accuracy:  0.911, Validation Accuracy:  0.920, Loss:  0.198\n",
      "Epoch  17 Batch   34/78 - Train Accuracy:  0.939, Validation Accuracy:  0.911, Loss:  0.174\n",
      "Epoch  17 Batch   35/78 - Train Accuracy:  0.914, Validation Accuracy:  0.914, Loss:  0.197\n",
      "Epoch  17 Batch   36/78 - Train Accuracy:  0.944, Validation Accuracy:  0.919, Loss:  0.184\n",
      "Epoch  17 Batch   37/78 - Train Accuracy:  0.913, Validation Accuracy:  0.930, Loss:  0.189\n",
      "Epoch  17 Batch   38/78 - Train Accuracy:  0.936, Validation Accuracy:  0.925, Loss:  0.178\n",
      "Epoch  17 Batch   39/78 - Train Accuracy:  0.923, Validation Accuracy:  0.925, Loss:  0.196\n",
      "Epoch  17 Batch   40/78 - Train Accuracy:  0.946, Validation Accuracy:  0.925, Loss:  0.170\n",
      "Epoch  17 Batch   41/78 - Train Accuracy:  0.911, Validation Accuracy:  0.930, Loss:  0.227\n",
      "Epoch  17 Batch   42/78 - Train Accuracy:  0.902, Validation Accuracy:  0.933, Loss:  0.184\n",
      "Epoch  17 Batch   43/78 - Train Accuracy:  0.914, Validation Accuracy:  0.927, Loss:  0.220\n",
      "Epoch  17 Batch   44/78 - Train Accuracy:  0.910, Validation Accuracy:  0.929, Loss:  0.185\n",
      "Epoch  17 Batch   45/78 - Train Accuracy:  0.906, Validation Accuracy:  0.927, Loss:  0.193\n",
      "Epoch  17 Batch   46/78 - Train Accuracy:  0.924, Validation Accuracy:  0.927, Loss:  0.196\n",
      "Epoch  17 Batch   47/78 - Train Accuracy:  0.929, Validation Accuracy:  0.925, Loss:  0.163\n",
      "Epoch  17 Batch   48/78 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.153\n",
      "Epoch  17 Batch   49/78 - Train Accuracy:  0.921, Validation Accuracy:  0.936, Loss:  0.187\n",
      "Epoch  17 Batch   50/78 - Train Accuracy:  0.908, Validation Accuracy:  0.933, Loss:  0.203\n",
      "Epoch  17 Batch   51/78 - Train Accuracy:  0.939, Validation Accuracy:  0.927, Loss:  0.169\n",
      "Epoch  17 Batch   52/78 - Train Accuracy:  0.944, Validation Accuracy:  0.927, Loss:  0.162\n",
      "Epoch  17 Batch   53/78 - Train Accuracy:  0.935, Validation Accuracy:  0.933, Loss:  0.163\n",
      "Epoch  17 Batch   54/78 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  0.184\n",
      "Epoch  17 Batch   55/78 - Train Accuracy:  0.929, Validation Accuracy:  0.933, Loss:  0.191\n",
      "Epoch  17 Batch   56/78 - Train Accuracy:  0.945, Validation Accuracy:  0.932, Loss:  0.174\n",
      "Epoch  17 Batch   57/78 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.194\n",
      "Epoch  17 Batch   58/78 - Train Accuracy:  0.921, Validation Accuracy:  0.924, Loss:  0.197\n",
      "Epoch  17 Batch   59/78 - Train Accuracy:  0.927, Validation Accuracy:  0.914, Loss:  0.177\n",
      "Epoch  17 Batch   60/78 - Train Accuracy:  0.921, Validation Accuracy:  0.914, Loss:  0.168\n",
      "Epoch  17 Batch   61/78 - Train Accuracy:  0.922, Validation Accuracy:  0.915, Loss:  0.190\n",
      "Epoch  17 Batch   62/78 - Train Accuracy:  0.911, Validation Accuracy:  0.925, Loss:  0.188\n",
      "Epoch  17 Batch   63/78 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.159\n",
      "Epoch  17 Batch   64/78 - Train Accuracy:  0.938, Validation Accuracy:  0.929, Loss:  0.162\n",
      "Epoch  17 Batch   65/78 - Train Accuracy:  0.927, Validation Accuracy:  0.926, Loss:  0.169\n",
      "Epoch  17 Batch   66/78 - Train Accuracy:  0.940, Validation Accuracy:  0.927, Loss:  0.154\n",
      "Epoch  17 Batch   67/78 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.162\n",
      "Epoch  17 Batch   68/78 - Train Accuracy:  0.939, Validation Accuracy:  0.929, Loss:  0.184\n",
      "Epoch  17 Batch   69/78 - Train Accuracy:  0.949, Validation Accuracy:  0.927, Loss:  0.140\n",
      "Epoch  17 Batch   70/78 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  0.170\n",
      "Epoch  17 Batch   71/78 - Train Accuracy:  0.955, Validation Accuracy:  0.929, Loss:  0.138\n",
      "Epoch  17 Batch   72/78 - Train Accuracy:  0.913, Validation Accuracy:  0.930, Loss:  0.176\n",
      "Epoch  17 Batch   73/78 - Train Accuracy:  0.938, Validation Accuracy:  0.926, Loss:  0.187\n",
      "Epoch  17 Batch   74/78 - Train Accuracy:  0.919, Validation Accuracy:  0.927, Loss:  0.183\n",
      "Epoch  17 Batch   75/78 - Train Accuracy:  0.927, Validation Accuracy:  0.931, Loss:  0.161\n",
      "Epoch  17 Batch   76/78 - Train Accuracy:  0.931, Validation Accuracy:  0.932, Loss:  0.176\n",
      "Epoch  18 Batch    0/78 - Train Accuracy:  0.926, Validation Accuracy:  0.934, Loss:  0.175\n",
      "Epoch  18 Batch    1/78 - Train Accuracy:  0.948, Validation Accuracy:  0.932, Loss:  0.148\n",
      "Epoch  18 Batch    2/78 - Train Accuracy:  0.945, Validation Accuracy:  0.930, Loss:  0.138\n",
      "Epoch  18 Batch    3/78 - Train Accuracy:  0.913, Validation Accuracy:  0.929, Loss:  0.168\n",
      "Epoch  18 Batch    4/78 - Train Accuracy:  0.943, Validation Accuracy:  0.930, Loss:  0.140\n",
      "Epoch  18 Batch    5/78 - Train Accuracy:  0.935, Validation Accuracy:  0.929, Loss:  0.151\n",
      "Epoch  18 Batch    6/78 - Train Accuracy:  0.938, Validation Accuracy:  0.927, Loss:  0.150\n",
      "Epoch  18 Batch    7/78 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.177\n",
      "Epoch  18 Batch    8/78 - Train Accuracy:  0.943, Validation Accuracy:  0.924, Loss:  0.151\n",
      "Epoch  18 Batch    9/78 - Train Accuracy:  0.949, Validation Accuracy:  0.920, Loss:  0.160\n",
      "Epoch  18 Batch   10/78 - Train Accuracy:  0.940, Validation Accuracy:  0.925, Loss:  0.152\n",
      "Epoch  18 Batch   11/78 - Train Accuracy:  0.927, Validation Accuracy:  0.935, Loss:  0.180\n",
      "Epoch  18 Batch   12/78 - Train Accuracy:  0.934, Validation Accuracy:  0.932, Loss:  0.178\n",
      "Epoch  18 Batch   13/78 - Train Accuracy:  0.924, Validation Accuracy:  0.934, Loss:  0.171\n",
      "Epoch  18 Batch   14/78 - Train Accuracy:  0.970, Validation Accuracy:  0.936, Loss:  0.126\n",
      "Epoch  18 Batch   15/78 - Train Accuracy:  0.917, Validation Accuracy:  0.939, Loss:  0.183\n",
      "Epoch  18 Batch   16/78 - Train Accuracy:  0.954, Validation Accuracy:  0.934, Loss:  0.146\n",
      "Epoch  18 Batch   17/78 - Train Accuracy:  0.922, Validation Accuracy:  0.932, Loss:  0.155\n",
      "Epoch  18 Batch   18/78 - Train Accuracy:  0.929, Validation Accuracy:  0.932, Loss:  0.172\n",
      "Epoch  18 Batch   19/78 - Train Accuracy:  0.939, Validation Accuracy:  0.925, Loss:  0.152\n",
      "Epoch  18 Batch   20/78 - Train Accuracy:  0.962, Validation Accuracy:  0.920, Loss:  0.120\n",
      "Epoch  18 Batch   21/78 - Train Accuracy:  0.932, Validation Accuracy:  0.923, Loss:  0.168\n",
      "Epoch  18 Batch   22/78 - Train Accuracy:  0.936, Validation Accuracy:  0.938, Loss:  0.162\n",
      "Epoch  18 Batch   23/78 - Train Accuracy:  0.939, Validation Accuracy:  0.936, Loss:  0.147\n",
      "Epoch  18 Batch   24/78 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  0.137\n",
      "Epoch  18 Batch   25/78 - Train Accuracy:  0.942, Validation Accuracy:  0.930, Loss:  0.155\n",
      "Epoch  18 Batch   26/78 - Train Accuracy:  0.915, Validation Accuracy:  0.931, Loss:  0.180\n",
      "Epoch  18 Batch   27/78 - Train Accuracy:  0.933, Validation Accuracy:  0.932, Loss:  0.160\n",
      "Epoch  18 Batch   28/78 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.168\n",
      "Epoch  18 Batch   29/78 - Train Accuracy:  0.913, Validation Accuracy:  0.925, Loss:  0.172\n",
      "Epoch  18 Batch   30/78 - Train Accuracy:  0.942, Validation Accuracy:  0.932, Loss:  0.157\n",
      "Epoch  18 Batch   31/78 - Train Accuracy:  0.924, Validation Accuracy:  0.922, Loss:  0.158\n",
      "Epoch  18 Batch   32/78 - Train Accuracy:  0.932, Validation Accuracy:  0.921, Loss:  0.159\n",
      "Epoch  18 Batch   33/78 - Train Accuracy:  0.917, Validation Accuracy:  0.911, Loss:  0.176\n",
      "Epoch  18 Batch   34/78 - Train Accuracy:  0.941, Validation Accuracy:  0.908, Loss:  0.155\n",
      "Epoch  18 Batch   35/78 - Train Accuracy:  0.927, Validation Accuracy:  0.906, Loss:  0.173\n",
      "Epoch  18 Batch   36/78 - Train Accuracy:  0.945, Validation Accuracy:  0.922, Loss:  0.166\n",
      "Epoch  18 Batch   37/78 - Train Accuracy:  0.936, Validation Accuracy:  0.934, Loss:  0.167\n",
      "Epoch  18 Batch   38/78 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  0.155\n",
      "Epoch  18 Batch   39/78 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.177\n",
      "Epoch  18 Batch   40/78 - Train Accuracy:  0.951, Validation Accuracy:  0.925, Loss:  0.151\n",
      "Epoch  18 Batch   41/78 - Train Accuracy:  0.913, Validation Accuracy:  0.926, Loss:  0.201\n",
      "Epoch  18 Batch   42/78 - Train Accuracy:  0.902, Validation Accuracy:  0.932, Loss:  0.164\n",
      "Epoch  18 Batch   43/78 - Train Accuracy:  0.920, Validation Accuracy:  0.934, Loss:  0.196\n",
      "Epoch  18 Batch   44/78 - Train Accuracy:  0.929, Validation Accuracy:  0.935, Loss:  0.169\n",
      "Epoch  18 Batch   45/78 - Train Accuracy:  0.912, Validation Accuracy:  0.932, Loss:  0.171\n",
      "Epoch  18 Batch   46/78 - Train Accuracy:  0.933, Validation Accuracy:  0.929, Loss:  0.175\n",
      "Epoch  18 Batch   47/78 - Train Accuracy:  0.943, Validation Accuracy:  0.921, Loss:  0.146\n",
      "Epoch  18 Batch   48/78 - Train Accuracy:  0.942, Validation Accuracy:  0.924, Loss:  0.137\n",
      "Epoch  18 Batch   49/78 - Train Accuracy:  0.932, Validation Accuracy:  0.936, Loss:  0.168\n",
      "Epoch  18 Batch   50/78 - Train Accuracy:  0.911, Validation Accuracy:  0.934, Loss:  0.182\n",
      "Epoch  18 Batch   51/78 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  0.148\n",
      "Epoch  18 Batch   52/78 - Train Accuracy:  0.951, Validation Accuracy:  0.934, Loss:  0.144\n",
      "Epoch  18 Batch   53/78 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  0.147\n",
      "Epoch  18 Batch   54/78 - Train Accuracy:  0.930, Validation Accuracy:  0.939, Loss:  0.164\n",
      "Epoch  18 Batch   55/78 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.172\n",
      "Epoch  18 Batch   56/78 - Train Accuracy:  0.948, Validation Accuracy:  0.931, Loss:  0.159\n",
      "Epoch  18 Batch   57/78 - Train Accuracy:  0.914, Validation Accuracy:  0.930, Loss:  0.173\n",
      "Epoch  18 Batch   58/78 - Train Accuracy:  0.934, Validation Accuracy:  0.934, Loss:  0.176\n",
      "Epoch  18 Batch   59/78 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.158\n",
      "Epoch  18 Batch   60/78 - Train Accuracy:  0.926, Validation Accuracy:  0.935, Loss:  0.152\n",
      "Epoch  18 Batch   61/78 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  0.168\n",
      "Epoch  18 Batch   62/78 - Train Accuracy:  0.922, Validation Accuracy:  0.927, Loss:  0.173\n",
      "Epoch  18 Batch   63/78 - Train Accuracy:  0.939, Validation Accuracy:  0.932, Loss:  0.145\n",
      "Epoch  18 Batch   64/78 - Train Accuracy:  0.943, Validation Accuracy:  0.935, Loss:  0.143\n",
      "Epoch  18 Batch   65/78 - Train Accuracy:  0.933, Validation Accuracy:  0.931, Loss:  0.153\n",
      "Epoch  18 Batch   66/78 - Train Accuracy:  0.942, Validation Accuracy:  0.933, Loss:  0.139\n",
      "Epoch  18 Batch   67/78 - Train Accuracy:  0.953, Validation Accuracy:  0.931, Loss:  0.146\n",
      "Epoch  18 Batch   68/78 - Train Accuracy:  0.945, Validation Accuracy:  0.931, Loss:  0.163\n",
      "Epoch  18 Batch   69/78 - Train Accuracy:  0.951, Validation Accuracy:  0.926, Loss:  0.126\n",
      "Epoch  18 Batch   70/78 - Train Accuracy:  0.940, Validation Accuracy:  0.932, Loss:  0.155\n",
      "Epoch  18 Batch   71/78 - Train Accuracy:  0.962, Validation Accuracy:  0.934, Loss:  0.122\n",
      "Epoch  18 Batch   72/78 - Train Accuracy:  0.921, Validation Accuracy:  0.938, Loss:  0.157\n",
      "Epoch  18 Batch   73/78 - Train Accuracy:  0.942, Validation Accuracy:  0.939, Loss:  0.168\n",
      "Epoch  18 Batch   74/78 - Train Accuracy:  0.925, Validation Accuracy:  0.942, Loss:  0.167\n",
      "Epoch  18 Batch   75/78 - Train Accuracy:  0.938, Validation Accuracy:  0.940, Loss:  0.142\n",
      "Epoch  18 Batch   76/78 - Train Accuracy:  0.939, Validation Accuracy:  0.936, Loss:  0.157\n",
      "Epoch  19 Batch    0/78 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.156\n",
      "Epoch  19 Batch    1/78 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  0.130\n",
      "Epoch  19 Batch    2/78 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  0.122\n",
      "Epoch  19 Batch    3/78 - Train Accuracy:  0.919, Validation Accuracy:  0.941, Loss:  0.149\n",
      "Epoch  19 Batch    4/78 - Train Accuracy:  0.948, Validation Accuracy:  0.941, Loss:  0.125\n",
      "Epoch  19 Batch    5/78 - Train Accuracy:  0.943, Validation Accuracy:  0.936, Loss:  0.134\n",
      "Epoch  19 Batch    6/78 - Train Accuracy:  0.946, Validation Accuracy:  0.932, Loss:  0.132\n",
      "Epoch  19 Batch    7/78 - Train Accuracy:  0.923, Validation Accuracy:  0.934, Loss:  0.160\n",
      "Epoch  19 Batch    8/78 - Train Accuracy:  0.955, Validation Accuracy:  0.936, Loss:  0.133\n",
      "Epoch  19 Batch    9/78 - Train Accuracy:  0.956, Validation Accuracy:  0.930, Loss:  0.142\n",
      "Epoch  19 Batch   10/78 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.135\n",
      "Epoch  19 Batch   11/78 - Train Accuracy:  0.936, Validation Accuracy:  0.935, Loss:  0.161\n",
      "Epoch  19 Batch   12/78 - Train Accuracy:  0.932, Validation Accuracy:  0.939, Loss:  0.160\n",
      "Epoch  19 Batch   13/78 - Train Accuracy:  0.923, Validation Accuracy:  0.942, Loss:  0.151\n",
      "Epoch  19 Batch   14/78 - Train Accuracy:  0.969, Validation Accuracy:  0.934, Loss:  0.112\n",
      "Epoch  19 Batch   15/78 - Train Accuracy:  0.924, Validation Accuracy:  0.942, Loss:  0.165\n",
      "Epoch  19 Batch   16/78 - Train Accuracy:  0.956, Validation Accuracy:  0.936, Loss:  0.130\n",
      "Epoch  19 Batch   17/78 - Train Accuracy:  0.926, Validation Accuracy:  0.938, Loss:  0.139\n",
      "Epoch  19 Batch   18/78 - Train Accuracy:  0.930, Validation Accuracy:  0.942, Loss:  0.155\n",
      "Epoch  19 Batch   19/78 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.138\n",
      "Epoch  19 Batch   20/78 - Train Accuracy:  0.964, Validation Accuracy:  0.929, Loss:  0.105\n",
      "Epoch  19 Batch   21/78 - Train Accuracy:  0.934, Validation Accuracy:  0.927, Loss:  0.150\n",
      "Epoch  19 Batch   22/78 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  0.145\n",
      "Epoch  19 Batch   23/78 - Train Accuracy:  0.944, Validation Accuracy:  0.950, Loss:  0.133\n",
      "Epoch  19 Batch   24/78 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  0.121\n",
      "Epoch  19 Batch   25/78 - Train Accuracy:  0.944, Validation Accuracy:  0.940, Loss:  0.138\n",
      "Epoch  19 Batch   26/78 - Train Accuracy:  0.927, Validation Accuracy:  0.935, Loss:  0.163\n",
      "Epoch  19 Batch   27/78 - Train Accuracy:  0.948, Validation Accuracy:  0.935, Loss:  0.143\n",
      "Epoch  19 Batch   28/78 - Train Accuracy:  0.932, Validation Accuracy:  0.935, Loss:  0.151\n",
      "Epoch  19 Batch   29/78 - Train Accuracy:  0.932, Validation Accuracy:  0.932, Loss:  0.157\n",
      "Epoch  19 Batch   30/78 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  0.142\n",
      "Epoch  19 Batch   31/78 - Train Accuracy:  0.923, Validation Accuracy:  0.932, Loss:  0.142\n",
      "Epoch  19 Batch   32/78 - Train Accuracy:  0.939, Validation Accuracy:  0.929, Loss:  0.142\n",
      "Epoch  19 Batch   33/78 - Train Accuracy:  0.922, Validation Accuracy:  0.931, Loss:  0.163\n",
      "Epoch  19 Batch   34/78 - Train Accuracy:  0.942, Validation Accuracy:  0.925, Loss:  0.139\n",
      "Epoch  19 Batch   35/78 - Train Accuracy:  0.936, Validation Accuracy:  0.911, Loss:  0.155\n",
      "Epoch  19 Batch   36/78 - Train Accuracy:  0.949, Validation Accuracy:  0.924, Loss:  0.155\n",
      "Epoch  19 Batch   37/78 - Train Accuracy:  0.949, Validation Accuracy:  0.933, Loss:  0.148\n",
      "Epoch  19 Batch   38/78 - Train Accuracy:  0.950, Validation Accuracy:  0.932, Loss:  0.139\n",
      "Epoch  19 Batch   39/78 - Train Accuracy:  0.932, Validation Accuracy:  0.924, Loss:  0.161\n",
      "Epoch  19 Batch   40/78 - Train Accuracy:  0.955, Validation Accuracy:  0.929, Loss:  0.140\n",
      "Epoch  19 Batch   41/78 - Train Accuracy:  0.917, Validation Accuracy:  0.931, Loss:  0.180\n",
      "Epoch  19 Batch   42/78 - Train Accuracy:  0.914, Validation Accuracy:  0.936, Loss:  0.148\n",
      "Epoch  19 Batch   43/78 - Train Accuracy:  0.921, Validation Accuracy:  0.938, Loss:  0.177\n",
      "Epoch  19 Batch   44/78 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  0.153\n",
      "Epoch  19 Batch   45/78 - Train Accuracy:  0.917, Validation Accuracy:  0.942, Loss:  0.153\n",
      "Epoch  19 Batch   46/78 - Train Accuracy:  0.934, Validation Accuracy:  0.939, Loss:  0.156\n",
      "Epoch  19 Batch   47/78 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.132\n",
      "Epoch  19 Batch   48/78 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.121\n",
      "Epoch  19 Batch   49/78 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.152\n",
      "Epoch  19 Batch   50/78 - Train Accuracy:  0.932, Validation Accuracy:  0.941, Loss:  0.167\n",
      "Epoch  19 Batch   51/78 - Train Accuracy:  0.952, Validation Accuracy:  0.938, Loss:  0.130\n",
      "Epoch  19 Batch   52/78 - Train Accuracy:  0.956, Validation Accuracy:  0.933, Loss:  0.131\n",
      "Epoch  19 Batch   53/78 - Train Accuracy:  0.950, Validation Accuracy:  0.942, Loss:  0.135\n",
      "Epoch  19 Batch   54/78 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.147\n",
      "Epoch  19 Batch   55/78 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.152\n",
      "Epoch  19 Batch   56/78 - Train Accuracy:  0.946, Validation Accuracy:  0.934, Loss:  0.148\n",
      "Epoch  19 Batch   57/78 - Train Accuracy:  0.920, Validation Accuracy:  0.938, Loss:  0.157\n",
      "Epoch  19 Batch   58/78 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  0.157\n",
      "Epoch  19 Batch   59/78 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.140\n",
      "Epoch  19 Batch   60/78 - Train Accuracy:  0.934, Validation Accuracy:  0.941, Loss:  0.142\n",
      "Epoch  19 Batch   61/78 - Train Accuracy:  0.942, Validation Accuracy:  0.938, Loss:  0.149\n",
      "Epoch  19 Batch   62/78 - Train Accuracy:  0.924, Validation Accuracy:  0.936, Loss:  0.157\n",
      "Epoch  19 Batch   63/78 - Train Accuracy:  0.940, Validation Accuracy:  0.935, Loss:  0.133\n",
      "Epoch  19 Batch   64/78 - Train Accuracy:  0.944, Validation Accuracy:  0.936, Loss:  0.131\n",
      "Epoch  19 Batch   65/78 - Train Accuracy:  0.935, Validation Accuracy:  0.938, Loss:  0.139\n",
      "Epoch  19 Batch   66/78 - Train Accuracy:  0.944, Validation Accuracy:  0.932, Loss:  0.124\n",
      "Epoch  19 Batch   67/78 - Train Accuracy:  0.958, Validation Accuracy:  0.936, Loss:  0.134\n",
      "Epoch  19 Batch   68/78 - Train Accuracy:  0.952, Validation Accuracy:  0.934, Loss:  0.147\n",
      "Epoch  19 Batch   69/78 - Train Accuracy:  0.949, Validation Accuracy:  0.932, Loss:  0.113\n",
      "Epoch  19 Batch   70/78 - Train Accuracy:  0.945, Validation Accuracy:  0.932, Loss:  0.142\n",
      "Epoch  19 Batch   71/78 - Train Accuracy:  0.958, Validation Accuracy:  0.939, Loss:  0.113\n",
      "Epoch  19 Batch   72/78 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  0.144\n",
      "Epoch  19 Batch   73/78 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.147\n",
      "Epoch  19 Batch   74/78 - Train Accuracy:  0.934, Validation Accuracy:  0.944, Loss:  0.154\n",
      "Epoch  19 Batch   75/78 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.128\n",
      "Epoch  19 Batch   76/78 - Train Accuracy:  0.942, Validation Accuracy:  0.943, Loss:  0.139\n",
      "Epoch  20 Batch    0/78 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  0.143\n",
      "Epoch  20 Batch    1/78 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.121\n",
      "Epoch  20 Batch    2/78 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.113\n",
      "Epoch  20 Batch    3/78 - Train Accuracy:  0.920, Validation Accuracy:  0.942, Loss:  0.135\n",
      "Epoch  20 Batch    4/78 - Train Accuracy:  0.962, Validation Accuracy:  0.942, Loss:  0.113\n",
      "Epoch  20 Batch    5/78 - Train Accuracy:  0.950, Validation Accuracy:  0.939, Loss:  0.126\n",
      "Epoch  20 Batch    6/78 - Train Accuracy:  0.954, Validation Accuracy:  0.934, Loss:  0.120\n",
      "Epoch  20 Batch    7/78 - Train Accuracy:  0.927, Validation Accuracy:  0.931, Loss:  0.144\n",
      "Epoch  20 Batch    8/78 - Train Accuracy:  0.975, Validation Accuracy:  0.939, Loss:  0.121\n",
      "Epoch  20 Batch    9/78 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  0.130\n",
      "Epoch  20 Batch   10/78 - Train Accuracy:  0.958, Validation Accuracy:  0.939, Loss:  0.122\n",
      "Epoch  20 Batch   11/78 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.142\n",
      "Epoch  20 Batch   12/78 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  0.147\n",
      "Epoch  20 Batch   13/78 - Train Accuracy:  0.925, Validation Accuracy:  0.941, Loss:  0.133\n",
      "Epoch  20 Batch   14/78 - Train Accuracy:  0.969, Validation Accuracy:  0.942, Loss:  0.101\n",
      "Epoch  20 Batch   15/78 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  0.151\n",
      "Epoch  20 Batch   16/78 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.118\n",
      "Epoch  20 Batch   17/78 - Train Accuracy:  0.931, Validation Accuracy:  0.948, Loss:  0.129\n",
      "Epoch  20 Batch   18/78 - Train Accuracy:  0.939, Validation Accuracy:  0.942, Loss:  0.140\n",
      "Epoch  20 Batch   19/78 - Train Accuracy:  0.944, Validation Accuracy:  0.940, Loss:  0.129\n",
      "Epoch  20 Batch   20/78 - Train Accuracy:  0.974, Validation Accuracy:  0.941, Loss:  0.095\n",
      "Epoch  20 Batch   21/78 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.135\n",
      "Epoch  20 Batch   22/78 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.131\n",
      "Epoch  20 Batch   23/78 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.124\n",
      "Epoch  20 Batch   24/78 - Train Accuracy:  0.973, Validation Accuracy:  0.944, Loss:  0.108\n",
      "Epoch  20 Batch   25/78 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.126\n",
      "Epoch  20 Batch   26/78 - Train Accuracy:  0.933, Validation Accuracy:  0.942, Loss:  0.150\n",
      "Epoch  20 Batch   27/78 - Train Accuracy:  0.953, Validation Accuracy:  0.941, Loss:  0.131\n",
      "Epoch  20 Batch   28/78 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.139\n",
      "Epoch  20 Batch   29/78 - Train Accuracy:  0.929, Validation Accuracy:  0.932, Loss:  0.145\n",
      "Epoch  20 Batch   30/78 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.134\n",
      "Epoch  20 Batch   31/78 - Train Accuracy:  0.924, Validation Accuracy:  0.933, Loss:  0.133\n",
      "Epoch  20 Batch   32/78 - Train Accuracy:  0.948, Validation Accuracy:  0.936, Loss:  0.126\n",
      "Epoch  20 Batch   33/78 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  0.156\n",
      "Epoch  20 Batch   34/78 - Train Accuracy:  0.951, Validation Accuracy:  0.932, Loss:  0.130\n",
      "Epoch  20 Batch   35/78 - Train Accuracy:  0.939, Validation Accuracy:  0.917, Loss:  0.137\n",
      "Epoch  20 Batch   36/78 - Train Accuracy:  0.954, Validation Accuracy:  0.925, Loss:  0.147\n",
      "Epoch  20 Batch   37/78 - Train Accuracy:  0.958, Validation Accuracy:  0.933, Loss:  0.137\n",
      "Epoch  20 Batch   38/78 - Train Accuracy:  0.952, Validation Accuracy:  0.930, Loss:  0.124\n",
      "Epoch  20 Batch   39/78 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  0.144\n",
      "Epoch  20 Batch   40/78 - Train Accuracy:  0.951, Validation Accuracy:  0.929, Loss:  0.131\n",
      "Epoch  20 Batch   41/78 - Train Accuracy:  0.912, Validation Accuracy:  0.929, Loss:  0.161\n",
      "Epoch  20 Batch   42/78 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.131\n",
      "Epoch  20 Batch   43/78 - Train Accuracy:  0.924, Validation Accuracy:  0.938, Loss:  0.155\n",
      "Epoch  20 Batch   44/78 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  0.147\n",
      "Epoch  20 Batch   45/78 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  0.138\n",
      "Epoch  20 Batch   46/78 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  0.135\n",
      "Epoch  20 Batch   47/78 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.120\n",
      "Epoch  20 Batch   48/78 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.108\n",
      "Epoch  20 Batch   49/78 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.137\n",
      "Epoch  20 Batch   50/78 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.156\n",
      "Epoch  20 Batch   51/78 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.117\n",
      "Epoch  20 Batch   52/78 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.119\n",
      "Epoch  20 Batch   53/78 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.120\n",
      "Epoch  20 Batch   54/78 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.134\n",
      "Epoch  20 Batch   55/78 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.132\n",
      "Epoch  20 Batch   56/78 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.136\n",
      "Epoch  20 Batch   57/78 - Train Accuracy:  0.921, Validation Accuracy:  0.952, Loss:  0.143\n",
      "Epoch  20 Batch   58/78 - Train Accuracy:  0.941, Validation Accuracy:  0.946, Loss:  0.144\n",
      "Epoch  20 Batch   59/78 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  0.122\n",
      "Epoch  20 Batch   60/78 - Train Accuracy:  0.936, Validation Accuracy:  0.950, Loss:  0.130\n",
      "Epoch  20 Batch   61/78 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  0.136\n",
      "Epoch  20 Batch   62/78 - Train Accuracy:  0.930, Validation Accuracy:  0.945, Loss:  0.139\n",
      "Epoch  20 Batch   63/78 - Train Accuracy:  0.945, Validation Accuracy:  0.941, Loss:  0.119\n",
      "Epoch  20 Batch   64/78 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.123\n",
      "Epoch  20 Batch   65/78 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.129\n",
      "Epoch  20 Batch   66/78 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  0.109\n",
      "Epoch  20 Batch   67/78 - Train Accuracy:  0.959, Validation Accuracy:  0.939, Loss:  0.118\n",
      "Epoch  20 Batch   68/78 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.138\n",
      "Epoch  20 Batch   69/78 - Train Accuracy:  0.953, Validation Accuracy:  0.940, Loss:  0.105\n",
      "Epoch  20 Batch   70/78 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.128\n",
      "Epoch  20 Batch   71/78 - Train Accuracy:  0.963, Validation Accuracy:  0.932, Loss:  0.100\n",
      "Epoch  20 Batch   72/78 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.136\n",
      "Epoch  20 Batch   73/78 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.132\n",
      "Epoch  20 Batch   74/78 - Train Accuracy:  0.929, Validation Accuracy:  0.944, Loss:  0.134\n",
      "Epoch  20 Batch   75/78 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.117\n",
      "Epoch  20 Batch   76/78 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  0.131\n",
      "Epoch  21 Batch    0/78 - Train Accuracy:  0.938, Validation Accuracy:  0.954, Loss:  0.126\n",
      "Epoch  21 Batch    1/78 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.108\n",
      "Epoch  21 Batch    2/78 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.102\n",
      "Epoch  21 Batch    3/78 - Train Accuracy:  0.923, Validation Accuracy:  0.946, Loss:  0.127\n",
      "Epoch  21 Batch    4/78 - Train Accuracy:  0.968, Validation Accuracy:  0.950, Loss:  0.102\n",
      "Epoch  21 Batch    5/78 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  0.110\n",
      "Epoch  21 Batch    6/78 - Train Accuracy:  0.956, Validation Accuracy:  0.946, Loss:  0.111\n",
      "Epoch  21 Batch    7/78 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  0.133\n",
      "Epoch  21 Batch    8/78 - Train Accuracy:  0.975, Validation Accuracy:  0.942, Loss:  0.104\n",
      "Epoch  21 Batch    9/78 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.115\n",
      "Epoch  21 Batch   10/78 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.113\n",
      "Epoch  21 Batch   11/78 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.129\n",
      "Epoch  21 Batch   12/78 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.130\n",
      "Epoch  21 Batch   13/78 - Train Accuracy:  0.940, Validation Accuracy:  0.948, Loss:  0.123\n",
      "Epoch  21 Batch   14/78 - Train Accuracy:  0.974, Validation Accuracy:  0.948, Loss:  0.096\n",
      "Epoch  21 Batch   15/78 - Train Accuracy:  0.941, Validation Accuracy:  0.942, Loss:  0.136\n",
      "Epoch  21 Batch   16/78 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.105\n",
      "Epoch  21 Batch   17/78 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  0.112\n",
      "Epoch  21 Batch   18/78 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  0.130\n",
      "Epoch  21 Batch   19/78 - Train Accuracy:  0.945, Validation Accuracy:  0.948, Loss:  0.113\n",
      "Epoch  21 Batch   20/78 - Train Accuracy:  0.974, Validation Accuracy:  0.946, Loss:  0.084\n",
      "Epoch  21 Batch   21/78 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.123\n",
      "Epoch  21 Batch   22/78 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  0.118\n",
      "Epoch  21 Batch   23/78 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  0.108\n",
      "Epoch  21 Batch   24/78 - Train Accuracy:  0.974, Validation Accuracy:  0.943, Loss:  0.096\n",
      "Epoch  21 Batch   25/78 - Train Accuracy:  0.967, Validation Accuracy:  0.950, Loss:  0.110\n",
      "Epoch  21 Batch   26/78 - Train Accuracy:  0.935, Validation Accuracy:  0.950, Loss:  0.131\n",
      "Epoch  21 Batch   27/78 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.114\n",
      "Epoch  21 Batch   28/78 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  0.121\n",
      "Epoch  21 Batch   29/78 - Train Accuracy:  0.939, Validation Accuracy:  0.951, Loss:  0.126\n",
      "Epoch  21 Batch   30/78 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.116\n",
      "Epoch  21 Batch   31/78 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.112\n",
      "Epoch  21 Batch   32/78 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  0.113\n",
      "Epoch  21 Batch   33/78 - Train Accuracy:  0.944, Validation Accuracy:  0.943, Loss:  0.131\n",
      "Epoch  21 Batch   34/78 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  0.111\n",
      "Epoch  21 Batch   35/78 - Train Accuracy:  0.949, Validation Accuracy:  0.934, Loss:  0.123\n",
      "Epoch  21 Batch   36/78 - Train Accuracy:  0.956, Validation Accuracy:  0.938, Loss:  0.115\n",
      "Epoch  21 Batch   37/78 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  0.120\n",
      "Epoch  21 Batch   38/78 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.105\n",
      "Epoch  21 Batch   39/78 - Train Accuracy:  0.944, Validation Accuracy:  0.945, Loss:  0.122\n",
      "Epoch  21 Batch   40/78 - Train Accuracy:  0.968, Validation Accuracy:  0.942, Loss:  0.111\n",
      "Epoch  21 Batch   41/78 - Train Accuracy:  0.940, Validation Accuracy:  0.946, Loss:  0.134\n",
      "Epoch  21 Batch   42/78 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  0.115\n",
      "Epoch  21 Batch   43/78 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.139\n",
      "Epoch  21 Batch   44/78 - Train Accuracy:  0.972, Validation Accuracy:  0.944, Loss:  0.122\n",
      "Epoch  21 Batch   45/78 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  0.126\n",
      "Epoch  21 Batch   46/78 - Train Accuracy:  0.950, Validation Accuracy:  0.958, Loss:  0.117\n",
      "Epoch  21 Batch   47/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.101\n",
      "Epoch  21 Batch   48/78 - Train Accuracy:  0.971, Validation Accuracy:  0.958, Loss:  0.099\n",
      "Epoch  21 Batch   49/78 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.127\n",
      "Epoch  21 Batch   50/78 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.136\n",
      "Epoch  21 Batch   51/78 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  0.109\n",
      "Epoch  21 Batch   52/78 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.108\n",
      "Epoch  21 Batch   53/78 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  0.098\n",
      "Epoch  21 Batch   54/78 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.121\n",
      "Epoch  21 Batch   55/78 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.117\n",
      "Epoch  21 Batch   56/78 - Train Accuracy:  0.964, Validation Accuracy:  0.951, Loss:  0.119\n",
      "Epoch  21 Batch   57/78 - Train Accuracy:  0.932, Validation Accuracy:  0.954, Loss:  0.129\n",
      "Epoch  21 Batch   58/78 - Train Accuracy:  0.941, Validation Accuracy:  0.955, Loss:  0.125\n",
      "Epoch  21 Batch   59/78 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.108\n",
      "Epoch  21 Batch   60/78 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.114\n",
      "Epoch  21 Batch   61/78 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.119\n",
      "Epoch  21 Batch   62/78 - Train Accuracy:  0.940, Validation Accuracy:  0.940, Loss:  0.127\n",
      "Epoch  21 Batch   63/78 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  0.111\n",
      "Epoch  21 Batch   64/78 - Train Accuracy:  0.942, Validation Accuracy:  0.939, Loss:  0.108\n",
      "Epoch  21 Batch   65/78 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.116\n",
      "Epoch  21 Batch   66/78 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  0.102\n",
      "Epoch  21 Batch   67/78 - Train Accuracy:  0.961, Validation Accuracy:  0.938, Loss:  0.101\n",
      "Epoch  21 Batch   68/78 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  0.124\n",
      "Epoch  21 Batch   69/78 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  0.091\n",
      "Epoch  21 Batch   70/78 - Train Accuracy:  0.951, Validation Accuracy:  0.946, Loss:  0.114\n",
      "Epoch  21 Batch   71/78 - Train Accuracy:  0.964, Validation Accuracy:  0.944, Loss:  0.090\n",
      "Epoch  21 Batch   72/78 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.114\n",
      "Epoch  21 Batch   73/78 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  0.117\n",
      "Epoch  21 Batch   74/78 - Train Accuracy:  0.942, Validation Accuracy:  0.949, Loss:  0.123\n",
      "Epoch  21 Batch   75/78 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.098\n",
      "Epoch  21 Batch   76/78 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.114\n",
      "Epoch  22 Batch    0/78 - Train Accuracy:  0.941, Validation Accuracy:  0.954, Loss:  0.112\n",
      "Epoch  22 Batch    1/78 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.089\n",
      "Epoch  22 Batch    2/78 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  0.090\n",
      "Epoch  22 Batch    3/78 - Train Accuracy:  0.923, Validation Accuracy:  0.954, Loss:  0.112\n",
      "Epoch  22 Batch    4/78 - Train Accuracy:  0.968, Validation Accuracy:  0.950, Loss:  0.089\n",
      "Epoch  22 Batch    5/78 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.097\n",
      "Epoch  22 Batch    6/78 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.098\n",
      "Epoch  22 Batch    7/78 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  0.117\n",
      "Epoch  22 Batch    8/78 - Train Accuracy:  0.981, Validation Accuracy:  0.953, Loss:  0.095\n",
      "Epoch  22 Batch    9/78 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.102\n",
      "Epoch  22 Batch   10/78 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  0.097\n",
      "Epoch  22 Batch   11/78 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.119\n",
      "Epoch  22 Batch   12/78 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  0.115\n",
      "Epoch  22 Batch   13/78 - Train Accuracy:  0.939, Validation Accuracy:  0.954, Loss:  0.108\n",
      "Epoch  22 Batch   14/78 - Train Accuracy:  0.978, Validation Accuracy:  0.955, Loss:  0.084\n",
      "Epoch  22 Batch   15/78 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.123\n",
      "Epoch  22 Batch   16/78 - Train Accuracy:  0.969, Validation Accuracy:  0.951, Loss:  0.094\n",
      "Epoch  22 Batch   17/78 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  0.101\n",
      "Epoch  22 Batch   18/78 - Train Accuracy:  0.952, Validation Accuracy:  0.950, Loss:  0.115\n",
      "Epoch  22 Batch   19/78 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.100\n",
      "Epoch  22 Batch   20/78 - Train Accuracy:  0.973, Validation Accuracy:  0.951, Loss:  0.078\n",
      "Epoch  22 Batch   21/78 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  0.110\n",
      "Epoch  22 Batch   22/78 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.105\n",
      "Epoch  22 Batch   23/78 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  0.097\n",
      "Epoch  22 Batch   24/78 - Train Accuracy:  0.975, Validation Accuracy:  0.952, Loss:  0.086\n",
      "Epoch  22 Batch   25/78 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.096\n",
      "Epoch  22 Batch   26/78 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.121\n",
      "Epoch  22 Batch   27/78 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.104\n",
      "Epoch  22 Batch   28/78 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  0.109\n",
      "Epoch  22 Batch   29/78 - Train Accuracy:  0.939, Validation Accuracy:  0.956, Loss:  0.118\n",
      "Epoch  22 Batch   30/78 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.103\n",
      "Epoch  22 Batch   31/78 - Train Accuracy:  0.944, Validation Accuracy:  0.948, Loss:  0.102\n",
      "Epoch  22 Batch   32/78 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.104\n",
      "Epoch  22 Batch   33/78 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  0.119\n",
      "Epoch  22 Batch   34/78 - Train Accuracy:  0.963, Validation Accuracy:  0.944, Loss:  0.100\n",
      "Epoch  22 Batch   35/78 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  0.114\n",
      "Epoch  22 Batch   36/78 - Train Accuracy:  0.960, Validation Accuracy:  0.944, Loss:  0.106\n",
      "Epoch  22 Batch   37/78 - Train Accuracy:  0.970, Validation Accuracy:  0.946, Loss:  0.108\n",
      "Epoch  22 Batch   38/78 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.099\n",
      "Epoch  22 Batch   39/78 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  0.112\n",
      "Epoch  22 Batch   40/78 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.099\n",
      "Epoch  22 Batch   41/78 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.122\n",
      "Epoch  22 Batch   42/78 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.103\n",
      "Epoch  22 Batch   43/78 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  0.126\n",
      "Epoch  22 Batch   44/78 - Train Accuracy:  0.973, Validation Accuracy:  0.946, Loss:  0.109\n",
      "Epoch  22 Batch   45/78 - Train Accuracy:  0.960, Validation Accuracy:  0.946, Loss:  0.115\n",
      "Epoch  22 Batch   46/78 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.105\n",
      "Epoch  22 Batch   47/78 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  0.091\n",
      "Epoch  22 Batch   48/78 - Train Accuracy:  0.972, Validation Accuracy:  0.949, Loss:  0.093\n",
      "Epoch  22 Batch   49/78 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.116\n",
      "Epoch  22 Batch   50/78 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.125\n",
      "Epoch  22 Batch   51/78 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.099\n",
      "Epoch  22 Batch   52/78 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.099\n",
      "Epoch  22 Batch   53/78 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  0.087\n",
      "Epoch  22 Batch   54/78 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.109\n",
      "Epoch  22 Batch   55/78 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  0.107\n",
      "Epoch  22 Batch   56/78 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  0.107\n",
      "Epoch  22 Batch   57/78 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.116\n",
      "Epoch  22 Batch   58/78 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.114\n",
      "Epoch  22 Batch   59/78 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.097\n",
      "Epoch  22 Batch   60/78 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.104\n",
      "Epoch  22 Batch   61/78 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.110\n",
      "Epoch  22 Batch   62/78 - Train Accuracy:  0.935, Validation Accuracy:  0.941, Loss:  0.114\n",
      "Epoch  22 Batch   63/78 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.102\n",
      "Epoch  22 Batch   64/78 - Train Accuracy:  0.953, Validation Accuracy:  0.940, Loss:  0.098\n",
      "Epoch  22 Batch   65/78 - Train Accuracy:  0.950, Validation Accuracy:  0.943, Loss:  0.103\n",
      "Epoch  22 Batch   66/78 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.092\n",
      "Epoch  22 Batch   67/78 - Train Accuracy:  0.962, Validation Accuracy:  0.942, Loss:  0.091\n",
      "Epoch  22 Batch   68/78 - Train Accuracy:  0.963, Validation Accuracy:  0.943, Loss:  0.106\n",
      "Epoch  22 Batch   69/78 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.083\n",
      "Epoch  22 Batch   70/78 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.103\n",
      "Epoch  22 Batch   71/78 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.078\n",
      "Epoch  22 Batch   72/78 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  0.103\n",
      "Epoch  22 Batch   73/78 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.106\n",
      "Epoch  22 Batch   74/78 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.110\n",
      "Epoch  22 Batch   75/78 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.088\n",
      "Epoch  22 Batch   76/78 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.101\n",
      "Epoch  23 Batch    0/78 - Train Accuracy:  0.951, Validation Accuracy:  0.963, Loss:  0.100\n",
      "Epoch  23 Batch    1/78 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  0.078\n",
      "Epoch  23 Batch    2/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.083\n",
      "Epoch  23 Batch    3/78 - Train Accuracy:  0.936, Validation Accuracy:  0.961, Loss:  0.102\n",
      "Epoch  23 Batch    4/78 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  0.081\n",
      "Epoch  23 Batch    5/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.087\n",
      "Epoch  23 Batch    6/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.086\n",
      "Epoch  23 Batch    7/78 - Train Accuracy:  0.951, Validation Accuracy:  0.958, Loss:  0.106\n",
      "Epoch  23 Batch    8/78 - Train Accuracy:  0.990, Validation Accuracy:  0.954, Loss:  0.084\n",
      "Epoch  23 Batch    9/78 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  0.090\n",
      "Epoch  23 Batch   10/78 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.087\n",
      "Epoch  23 Batch   11/78 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  0.104\n",
      "Epoch  23 Batch   12/78 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  0.104\n",
      "Epoch  23 Batch   13/78 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.096\n",
      "Epoch  23 Batch   14/78 - Train Accuracy:  0.980, Validation Accuracy:  0.959, Loss:  0.074\n",
      "Epoch  23 Batch   15/78 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.112\n",
      "Epoch  23 Batch   16/78 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.085\n",
      "Epoch  23 Batch   17/78 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.089\n",
      "Epoch  23 Batch   18/78 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.103\n",
      "Epoch  23 Batch   19/78 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.090\n",
      "Epoch  23 Batch   20/78 - Train Accuracy:  0.978, Validation Accuracy:  0.952, Loss:  0.067\n",
      "Epoch  23 Batch   21/78 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  0.098\n",
      "Epoch  23 Batch   22/78 - Train Accuracy:  0.956, Validation Accuracy:  0.946, Loss:  0.095\n",
      "Epoch  23 Batch   23/78 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.086\n",
      "Epoch  23 Batch   24/78 - Train Accuracy:  0.984, Validation Accuracy:  0.956, Loss:  0.077\n",
      "Epoch  23 Batch   25/78 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.084\n",
      "Epoch  23 Batch   26/78 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.108\n",
      "Epoch  23 Batch   27/78 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.092\n",
      "Epoch  23 Batch   28/78 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  0.098\n",
      "Epoch  23 Batch   29/78 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.105\n",
      "Epoch  23 Batch   30/78 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.093\n",
      "Epoch  23 Batch   31/78 - Train Accuracy:  0.954, Validation Accuracy:  0.954, Loss:  0.091\n",
      "Epoch  23 Batch   32/78 - Train Accuracy:  0.960, Validation Accuracy:  0.944, Loss:  0.093\n",
      "Epoch  23 Batch   33/78 - Train Accuracy:  0.949, Validation Accuracy:  0.946, Loss:  0.109\n",
      "Epoch  23 Batch   34/78 - Train Accuracy:  0.977, Validation Accuracy:  0.943, Loss:  0.089\n",
      "Epoch  23 Batch   35/78 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.100\n",
      "Epoch  23 Batch   36/78 - Train Accuracy:  0.964, Validation Accuracy:  0.939, Loss:  0.098\n",
      "Epoch  23 Batch   37/78 - Train Accuracy:  0.969, Validation Accuracy:  0.946, Loss:  0.100\n",
      "Epoch  23 Batch   38/78 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  0.087\n",
      "Epoch  23 Batch   39/78 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.105\n",
      "Epoch  23 Batch   40/78 - Train Accuracy:  0.970, Validation Accuracy:  0.943, Loss:  0.091\n",
      "Epoch  23 Batch   41/78 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  0.108\n",
      "Epoch  23 Batch   42/78 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  0.093\n",
      "Epoch  23 Batch   43/78 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.117\n",
      "Epoch  23 Batch   44/78 - Train Accuracy:  0.972, Validation Accuracy:  0.948, Loss:  0.099\n",
      "Epoch  23 Batch   45/78 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.108\n",
      "Epoch  23 Batch   46/78 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.093\n",
      "Epoch  23 Batch   47/78 - Train Accuracy:  0.970, Validation Accuracy:  0.946, Loss:  0.082\n",
      "Epoch  23 Batch   48/78 - Train Accuracy:  0.979, Validation Accuracy:  0.949, Loss:  0.089\n",
      "Epoch  23 Batch   49/78 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  0.107\n",
      "Epoch  23 Batch   50/78 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.115\n",
      "Epoch  23 Batch   51/78 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.091\n",
      "Epoch  23 Batch   52/78 - Train Accuracy:  0.973, Validation Accuracy:  0.958, Loss:  0.090\n",
      "Epoch  23 Batch   53/78 - Train Accuracy:  0.974, Validation Accuracy:  0.954, Loss:  0.079\n",
      "Epoch  23 Batch   54/78 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.100\n",
      "Epoch  23 Batch   55/78 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  0.096\n",
      "Epoch  23 Batch   56/78 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  0.097\n",
      "Epoch  23 Batch   57/78 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.105\n",
      "Epoch  23 Batch   58/78 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  0.105\n",
      "Epoch  23 Batch   59/78 - Train Accuracy:  0.979, Validation Accuracy:  0.958, Loss:  0.086\n",
      "Epoch  23 Batch   60/78 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  0.095\n",
      "Epoch  23 Batch   61/78 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  0.101\n",
      "Epoch  23 Batch   62/78 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.103\n",
      "Epoch  23 Batch   63/78 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.092\n",
      "Epoch  23 Batch   64/78 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.089\n",
      "Epoch  23 Batch   65/78 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.095\n",
      "Epoch  23 Batch   66/78 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.082\n",
      "Epoch  23 Batch   67/78 - Train Accuracy:  0.973, Validation Accuracy:  0.950, Loss:  0.083\n",
      "Epoch  23 Batch   68/78 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.096\n",
      "Epoch  23 Batch   69/78 - Train Accuracy:  0.954, Validation Accuracy:  0.960, Loss:  0.076\n",
      "Epoch  23 Batch   70/78 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.095\n",
      "Epoch  23 Batch   71/78 - Train Accuracy:  0.978, Validation Accuracy:  0.954, Loss:  0.069\n",
      "Epoch  23 Batch   72/78 - Train Accuracy:  0.963, Validation Accuracy:  0.950, Loss:  0.095\n",
      "Epoch  23 Batch   73/78 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.095\n",
      "Epoch  23 Batch   74/78 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.101\n",
      "Epoch  23 Batch   75/78 - Train Accuracy:  0.978, Validation Accuracy:  0.954, Loss:  0.078\n",
      "Epoch  23 Batch   76/78 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.093\n",
      "Epoch  24 Batch    0/78 - Train Accuracy:  0.952, Validation Accuracy:  0.960, Loss:  0.092\n",
      "Epoch  24 Batch    1/78 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  0.069\n",
      "Epoch  24 Batch    2/78 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.074\n",
      "Epoch  24 Batch    3/78 - Train Accuracy:  0.938, Validation Accuracy:  0.963, Loss:  0.095\n",
      "Epoch  24 Batch    4/78 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  0.075\n",
      "Epoch  24 Batch    5/78 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.079\n",
      "Epoch  24 Batch    6/78 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  0.077\n",
      "Epoch  24 Batch    7/78 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.096\n",
      "Epoch  24 Batch    8/78 - Train Accuracy:  0.990, Validation Accuracy:  0.958, Loss:  0.076\n",
      "Epoch  24 Batch    9/78 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  0.082\n",
      "Epoch  24 Batch   10/78 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  0.078\n",
      "Epoch  24 Batch   11/78 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.095\n",
      "Epoch  24 Batch   12/78 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  0.095\n",
      "Epoch  24 Batch   13/78 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.087\n",
      "Epoch  24 Batch   14/78 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  0.066\n",
      "Epoch  24 Batch   15/78 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  0.102\n",
      "Epoch  24 Batch   16/78 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  0.077\n",
      "Epoch  24 Batch   17/78 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.080\n",
      "Epoch  24 Batch   18/78 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.093\n",
      "Epoch  24 Batch   19/78 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.081\n",
      "Epoch  24 Batch   20/78 - Train Accuracy:  0.980, Validation Accuracy:  0.953, Loss:  0.060\n",
      "Epoch  24 Batch   21/78 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.088\n",
      "Epoch  24 Batch   22/78 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.086\n",
      "Epoch  24 Batch   23/78 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.078\n",
      "Epoch  24 Batch   24/78 - Train Accuracy:  0.987, Validation Accuracy:  0.954, Loss:  0.070\n",
      "Epoch  24 Batch   25/78 - Train Accuracy:  0.975, Validation Accuracy:  0.958, Loss:  0.075\n",
      "Epoch  24 Batch   26/78 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.097\n",
      "Epoch  24 Batch   27/78 - Train Accuracy:  0.981, Validation Accuracy:  0.952, Loss:  0.082\n",
      "Epoch  24 Batch   28/78 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  0.089\n",
      "Epoch  24 Batch   29/78 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.096\n",
      "Epoch  24 Batch   30/78 - Train Accuracy:  0.967, Validation Accuracy:  0.955, Loss:  0.083\n",
      "Epoch  24 Batch   31/78 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  0.082\n",
      "Epoch  24 Batch   32/78 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.084\n",
      "Epoch  24 Batch   33/78 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.100\n",
      "Epoch  24 Batch   34/78 - Train Accuracy:  0.981, Validation Accuracy:  0.950, Loss:  0.080\n",
      "Epoch  24 Batch   35/78 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.090\n",
      "Epoch  24 Batch   36/78 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  0.088\n",
      "Epoch  24 Batch   37/78 - Train Accuracy:  0.965, Validation Accuracy:  0.946, Loss:  0.090\n",
      "Epoch  24 Batch   38/78 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  0.078\n",
      "Epoch  24 Batch   39/78 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.094\n",
      "Epoch  24 Batch   40/78 - Train Accuracy:  0.974, Validation Accuracy:  0.951, Loss:  0.083\n",
      "Epoch  24 Batch   41/78 - Train Accuracy:  0.953, Validation Accuracy:  0.954, Loss:  0.096\n",
      "Epoch  24 Batch   42/78 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.081\n",
      "Epoch  24 Batch   43/78 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  0.110\n",
      "Epoch  24 Batch   44/78 - Train Accuracy:  0.973, Validation Accuracy:  0.953, Loss:  0.087\n",
      "Epoch  24 Batch   45/78 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.096\n",
      "Epoch  24 Batch   46/78 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  0.087\n",
      "Epoch  24 Batch   47/78 - Train Accuracy:  0.971, Validation Accuracy:  0.948, Loss:  0.072\n",
      "Epoch  24 Batch   48/78 - Train Accuracy:  0.979, Validation Accuracy:  0.945, Loss:  0.078\n",
      "Epoch  24 Batch   49/78 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.104\n",
      "Epoch  24 Batch   50/78 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.103\n",
      "Epoch  24 Batch   51/78 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  0.085\n",
      "Epoch  24 Batch   52/78 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  0.089\n",
      "Epoch  24 Batch   53/78 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.069\n",
      "Epoch  24 Batch   54/78 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.091\n",
      "Epoch  24 Batch   55/78 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  0.092\n",
      "Epoch  24 Batch   56/78 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  0.088\n",
      "Epoch  24 Batch   57/78 - Train Accuracy:  0.952, Validation Accuracy:  0.960, Loss:  0.096\n",
      "Epoch  24 Batch   58/78 - Train Accuracy:  0.956, Validation Accuracy:  0.964, Loss:  0.100\n",
      "Epoch  24 Batch   59/78 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  0.078\n",
      "Epoch  24 Batch   60/78 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  0.086\n",
      "Epoch  24 Batch   61/78 - Train Accuracy:  0.953, Validation Accuracy:  0.970, Loss:  0.096\n",
      "Epoch  24 Batch   62/78 - Train Accuracy:  0.945, Validation Accuracy:  0.963, Loss:  0.095\n",
      "Epoch  24 Batch   63/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.086\n",
      "Epoch  24 Batch   64/78 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  0.083\n",
      "Epoch  24 Batch   65/78 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.088\n",
      "Epoch  24 Batch   66/78 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  0.074\n",
      "Epoch  24 Batch   67/78 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.075\n",
      "Epoch  24 Batch   68/78 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.089\n",
      "Epoch  24 Batch   69/78 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  0.070\n",
      "Epoch  24 Batch   70/78 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.089\n",
      "Epoch  24 Batch   71/78 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  0.062\n",
      "Epoch  24 Batch   72/78 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  0.086\n",
      "Epoch  24 Batch   73/78 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.087\n",
      "Epoch  24 Batch   74/78 - Train Accuracy:  0.964, Validation Accuracy:  0.956, Loss:  0.092\n",
      "Epoch  24 Batch   75/78 - Train Accuracy:  0.984, Validation Accuracy:  0.959, Loss:  0.070\n",
      "Epoch  24 Batch   76/78 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.085\n",
      "Epoch  25 Batch    0/78 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  0.083\n",
      "Epoch  25 Batch    1/78 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  0.064\n",
      "Epoch  25 Batch    2/78 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  0.068\n",
      "Epoch  25 Batch    3/78 - Train Accuracy:  0.946, Validation Accuracy:  0.964, Loss:  0.088\n",
      "Epoch  25 Batch    4/78 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  0.070\n",
      "Epoch  25 Batch    5/78 - Train Accuracy:  0.963, Validation Accuracy:  0.965, Loss:  0.073\n",
      "Epoch  25 Batch    6/78 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  0.069\n",
      "Epoch  25 Batch    7/78 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.085\n",
      "Epoch  25 Batch    8/78 - Train Accuracy:  0.992, Validation Accuracy:  0.959, Loss:  0.069\n",
      "Epoch  25 Batch    9/78 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  0.077\n",
      "Epoch  25 Batch   10/78 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  0.071\n",
      "Epoch  25 Batch   11/78 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  0.088\n",
      "Epoch  25 Batch   12/78 - Train Accuracy:  0.959, Validation Accuracy:  0.967, Loss:  0.088\n",
      "Epoch  25 Batch   13/78 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  0.080\n",
      "Epoch  25 Batch   14/78 - Train Accuracy:  0.983, Validation Accuracy:  0.960, Loss:  0.060\n",
      "Epoch  25 Batch   15/78 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.097\n",
      "Epoch  25 Batch   16/78 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  0.071\n",
      "Epoch  25 Batch   17/78 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  0.073\n",
      "Epoch  25 Batch   18/78 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.089\n",
      "Epoch  25 Batch   19/78 - Train Accuracy:  0.965, Validation Accuracy:  0.954, Loss:  0.074\n",
      "Epoch  25 Batch   20/78 - Train Accuracy:  0.983, Validation Accuracy:  0.956, Loss:  0.056\n",
      "Epoch  25 Batch   21/78 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.083\n",
      "Epoch  25 Batch   22/78 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  0.079\n",
      "Epoch  25 Batch   23/78 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  0.071\n",
      "Epoch  25 Batch   24/78 - Train Accuracy:  0.985, Validation Accuracy:  0.961, Loss:  0.065\n",
      "Epoch  25 Batch   25/78 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  0.068\n",
      "Epoch  25 Batch   26/78 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.089\n",
      "Epoch  25 Batch   27/78 - Train Accuracy:  0.984, Validation Accuracy:  0.959, Loss:  0.074\n",
      "Epoch  25 Batch   28/78 - Train Accuracy:  0.973, Validation Accuracy:  0.949, Loss:  0.083\n",
      "Epoch  25 Batch   29/78 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.087\n",
      "Epoch  25 Batch   30/78 - Train Accuracy:  0.968, Validation Accuracy:  0.954, Loss:  0.075\n",
      "Epoch  25 Batch   31/78 - Train Accuracy:  0.964, Validation Accuracy:  0.956, Loss:  0.075\n",
      "Epoch  25 Batch   32/78 - Train Accuracy:  0.965, Validation Accuracy:  0.953, Loss:  0.076\n",
      "Epoch  25 Batch   33/78 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.091\n",
      "Epoch  25 Batch   34/78 - Train Accuracy:  0.988, Validation Accuracy:  0.956, Loss:  0.074\n",
      "Epoch  25 Batch   35/78 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.082\n",
      "Epoch  25 Batch   36/78 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  0.078\n",
      "Epoch  25 Batch   37/78 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.081\n",
      "Epoch  25 Batch   38/78 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.071\n",
      "Epoch  25 Batch   39/78 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.083\n",
      "Epoch  25 Batch   40/78 - Train Accuracy:  0.979, Validation Accuracy:  0.951, Loss:  0.074\n",
      "Epoch  25 Batch   41/78 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.088\n",
      "Epoch  25 Batch   42/78 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  0.072\n",
      "Epoch  25 Batch   43/78 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  0.099\n",
      "Epoch  25 Batch   44/78 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  0.077\n",
      "Epoch  25 Batch   45/78 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.083\n",
      "Epoch  25 Batch   46/78 - Train Accuracy:  0.983, Validation Accuracy:  0.954, Loss:  0.079\n",
      "Epoch  25 Batch   47/78 - Train Accuracy:  0.981, Validation Accuracy:  0.954, Loss:  0.068\n",
      "Epoch  25 Batch   48/78 - Train Accuracy:  0.983, Validation Accuracy:  0.953, Loss:  0.065\n",
      "Epoch  25 Batch   49/78 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.093\n",
      "Epoch  25 Batch   50/78 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.095\n",
      "Epoch  25 Batch   51/78 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  0.071\n",
      "Epoch  25 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  0.083\n",
      "Epoch  25 Batch   53/78 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  0.063\n",
      "Epoch  25 Batch   54/78 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  0.075\n",
      "Epoch  25 Batch   55/78 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  0.080\n",
      "Epoch  25 Batch   56/78 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  0.083\n",
      "Epoch  25 Batch   57/78 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  0.083\n",
      "Epoch  25 Batch   58/78 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  0.086\n",
      "Epoch  25 Batch   59/78 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  0.079\n",
      "Epoch  25 Batch   60/78 - Train Accuracy:  0.956, Validation Accuracy:  0.970, Loss:  0.076\n",
      "Epoch  25 Batch   61/78 - Train Accuracy:  0.955, Validation Accuracy:  0.967, Loss:  0.083\n",
      "Epoch  25 Batch   62/78 - Train Accuracy:  0.953, Validation Accuracy:  0.973, Loss:  0.091\n",
      "Epoch  25 Batch   63/78 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.080\n",
      "Epoch  25 Batch   64/78 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.069\n",
      "Epoch  25 Batch   65/78 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.088\n",
      "Epoch  25 Batch   66/78 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.066\n",
      "Epoch  25 Batch   67/78 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.065\n",
      "Epoch  25 Batch   68/78 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.082\n",
      "Epoch  25 Batch   69/78 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.067\n",
      "Epoch  25 Batch   70/78 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.079\n",
      "Epoch  25 Batch   71/78 - Train Accuracy:  0.989, Validation Accuracy:  0.960, Loss:  0.056\n",
      "Epoch  25 Batch   72/78 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  0.082\n",
      "Epoch  25 Batch   73/78 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.079\n",
      "Epoch  25 Batch   74/78 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.085\n",
      "Epoch  25 Batch   75/78 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  0.066\n",
      "Epoch  25 Batch   76/78 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  0.086\n",
      "Epoch  26 Batch    0/78 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.073\n",
      "Epoch  26 Batch    1/78 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  0.059\n",
      "Epoch  26 Batch    2/78 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  0.069\n",
      "Epoch  26 Batch    3/78 - Train Accuracy:  0.943, Validation Accuracy:  0.965, Loss:  0.083\n",
      "Epoch  26 Batch    4/78 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.064\n",
      "Epoch  26 Batch    5/78 - Train Accuracy:  0.965, Validation Accuracy:  0.970, Loss:  0.072\n",
      "Epoch  26 Batch    6/78 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  0.065\n",
      "Epoch  26 Batch    7/78 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.076\n",
      "Epoch  26 Batch    8/78 - Train Accuracy:  0.990, Validation Accuracy:  0.961, Loss:  0.062\n",
      "Epoch  26 Batch    9/78 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  0.074\n",
      "Epoch  26 Batch   10/78 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  0.067\n",
      "Epoch  26 Batch   11/78 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  0.076\n",
      "Epoch  26 Batch   12/78 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  0.081\n",
      "Epoch  26 Batch   13/78 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  0.074\n",
      "Epoch  26 Batch   14/78 - Train Accuracy:  0.984, Validation Accuracy:  0.960, Loss:  0.054\n",
      "Epoch  26 Batch   15/78 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  0.091\n",
      "Epoch  26 Batch   16/78 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  0.064\n",
      "Epoch  26 Batch   17/78 - Train Accuracy:  0.964, Validation Accuracy:  0.968, Loss:  0.067\n",
      "Epoch  26 Batch   18/78 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  0.082\n",
      "Epoch  26 Batch   19/78 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.070\n",
      "Epoch  26 Batch   20/78 - Train Accuracy:  0.988, Validation Accuracy:  0.953, Loss:  0.048\n",
      "Epoch  26 Batch   21/78 - Train Accuracy:  0.970, Validation Accuracy:  0.953, Loss:  0.075\n",
      "Epoch  26 Batch   22/78 - Train Accuracy:  0.970, Validation Accuracy:  0.955, Loss:  0.075\n",
      "Epoch  26 Batch   23/78 - Train Accuracy:  0.973, Validation Accuracy:  0.956, Loss:  0.067\n",
      "Epoch  26 Batch   24/78 - Train Accuracy:  0.981, Validation Accuracy:  0.960, Loss:  0.057\n",
      "Epoch  26 Batch   25/78 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  0.063\n",
      "Epoch  26 Batch   26/78 - Train Accuracy:  0.962, Validation Accuracy:  0.968, Loss:  0.083\n",
      "Epoch  26 Batch   27/78 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  0.067\n",
      "Epoch  26 Batch   28/78 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  0.077\n",
      "Epoch  26 Batch   29/78 - Train Accuracy:  0.969, Validation Accuracy:  0.952, Loss:  0.079\n",
      "Epoch  26 Batch   30/78 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  0.069\n",
      "Epoch  26 Batch   31/78 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  0.068\n",
      "Epoch  26 Batch   32/78 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.070\n",
      "Epoch  26 Batch   33/78 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.086\n",
      "Epoch  26 Batch   34/78 - Train Accuracy:  0.991, Validation Accuracy:  0.956, Loss:  0.066\n",
      "Epoch  26 Batch   35/78 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.075\n",
      "Epoch  26 Batch   36/78 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.071\n",
      "Epoch  26 Batch   37/78 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.074\n",
      "Epoch  26 Batch   38/78 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.065\n",
      "Epoch  26 Batch   39/78 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.076\n",
      "Epoch  26 Batch   40/78 - Train Accuracy:  0.984, Validation Accuracy:  0.958, Loss:  0.068\n",
      "Epoch  26 Batch   41/78 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  0.079\n",
      "Epoch  26 Batch   42/78 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  0.065\n",
      "Epoch  26 Batch   43/78 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  0.087\n",
      "Epoch  26 Batch   44/78 - Train Accuracy:  0.975, Validation Accuracy:  0.959, Loss:  0.072\n",
      "Epoch  26 Batch   45/78 - Train Accuracy:  0.958, Validation Accuracy:  0.960, Loss:  0.077\n",
      "Epoch  26 Batch   46/78 - Train Accuracy:  0.980, Validation Accuracy:  0.956, Loss:  0.069\n",
      "Epoch  26 Batch   47/78 - Train Accuracy:  0.989, Validation Accuracy:  0.958, Loss:  0.065\n",
      "Epoch  26 Batch   48/78 - Train Accuracy:  0.988, Validation Accuracy:  0.954, Loss:  0.059\n",
      "Epoch  26 Batch   49/78 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.078\n",
      "Epoch  26 Batch   50/78 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.083\n",
      "Epoch  26 Batch   51/78 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  0.062\n",
      "Epoch  26 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  0.068\n",
      "Epoch  26 Batch   53/78 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  0.058\n",
      "Epoch  26 Batch   54/78 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  0.070\n",
      "Epoch  26 Batch   55/78 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  0.070\n",
      "Epoch  26 Batch   56/78 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  0.073\n",
      "Epoch  26 Batch   57/78 - Train Accuracy:  0.970, Validation Accuracy:  0.975, Loss:  0.076\n",
      "Epoch  26 Batch   58/78 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  0.081\n",
      "Epoch  26 Batch   59/78 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  0.064\n",
      "Epoch  26 Batch   60/78 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  0.070\n",
      "Epoch  26 Batch   61/78 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  0.076\n",
      "Epoch  26 Batch   62/78 - Train Accuracy:  0.959, Validation Accuracy:  0.972, Loss:  0.081\n",
      "Epoch  26 Batch   63/78 - Train Accuracy:  0.961, Validation Accuracy:  0.974, Loss:  0.075\n",
      "Epoch  26 Batch   64/78 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  0.066\n",
      "Epoch  26 Batch   65/78 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  0.072\n",
      "Epoch  26 Batch   66/78 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  0.064\n",
      "Epoch  26 Batch   67/78 - Train Accuracy:  0.974, Validation Accuracy:  0.963, Loss:  0.063\n",
      "Epoch  26 Batch   68/78 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.075\n",
      "Epoch  26 Batch   69/78 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  0.061\n",
      "Epoch  26 Batch   70/78 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  0.080\n",
      "Epoch  26 Batch   71/78 - Train Accuracy:  0.990, Validation Accuracy:  0.964, Loss:  0.055\n",
      "Epoch  26 Batch   72/78 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.074\n",
      "Epoch  26 Batch   73/78 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  0.072\n",
      "Epoch  26 Batch   74/78 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  0.079\n",
      "Epoch  26 Batch   75/78 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  0.058\n",
      "Epoch  26 Batch   76/78 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  0.079\n",
      "Epoch  27 Batch    0/78 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  0.070\n",
      "Epoch  27 Batch    1/78 - Train Accuracy:  0.978, Validation Accuracy:  0.959, Loss:  0.052\n",
      "Epoch  27 Batch    2/78 - Train Accuracy:  0.984, Validation Accuracy:  0.959, Loss:  0.056\n",
      "Epoch  27 Batch    3/78 - Train Accuracy:  0.951, Validation Accuracy:  0.962, Loss:  0.077\n",
      "Epoch  27 Batch    4/78 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.061\n",
      "Epoch  27 Batch    5/78 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  0.059\n",
      "Epoch  27 Batch    6/78 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  0.059\n",
      "Epoch  27 Batch    7/78 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  0.072\n",
      "Epoch  27 Batch    8/78 - Train Accuracy:  0.991, Validation Accuracy:  0.959, Loss:  0.058\n",
      "Epoch  27 Batch    9/78 - Train Accuracy:  0.974, Validation Accuracy:  0.955, Loss:  0.063\n",
      "Epoch  27 Batch   10/78 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  0.066\n",
      "Epoch  27 Batch   11/78 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  0.069\n",
      "Epoch  27 Batch   12/78 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.071\n",
      "Epoch  27 Batch   13/78 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  0.072\n",
      "Epoch  27 Batch   14/78 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  0.049\n",
      "Epoch  27 Batch   15/78 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  0.076\n",
      "Epoch  27 Batch   16/78 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  0.065\n",
      "Epoch  27 Batch   17/78 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  0.061\n",
      "Epoch  27 Batch   18/78 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  0.069\n",
      "Epoch  27 Batch   19/78 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.063\n",
      "Epoch  27 Batch   20/78 - Train Accuracy:  0.989, Validation Accuracy:  0.960, Loss:  0.044\n",
      "Epoch  27 Batch   21/78 - Train Accuracy:  0.974, Validation Accuracy:  0.953, Loss:  0.067\n",
      "Epoch  27 Batch   22/78 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  0.064\n",
      "Epoch  27 Batch   23/78 - Train Accuracy:  0.980, Validation Accuracy:  0.954, Loss:  0.065\n",
      "Epoch  27 Batch   24/78 - Train Accuracy:  0.989, Validation Accuracy:  0.956, Loss:  0.052\n",
      "Epoch  27 Batch   25/78 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  0.055\n",
      "Epoch  27 Batch   26/78 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  0.073\n",
      "Epoch  27 Batch   27/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.061\n",
      "Epoch  27 Batch   28/78 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  0.070\n",
      "Epoch  27 Batch   29/78 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  0.074\n",
      "Epoch  27 Batch   30/78 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  0.065\n",
      "Epoch  27 Batch   31/78 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.061\n",
      "Epoch  27 Batch   32/78 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  0.065\n",
      "Epoch  27 Batch   33/78 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  0.082\n",
      "Epoch  27 Batch   34/78 - Train Accuracy:  0.991, Validation Accuracy:  0.964, Loss:  0.059\n",
      "Epoch  27 Batch   35/78 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  0.067\n",
      "Epoch  27 Batch   36/78 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  0.064\n",
      "Epoch  27 Batch   37/78 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  0.069\n",
      "Epoch  27 Batch   38/78 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  0.060\n",
      "Epoch  27 Batch   39/78 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  0.069\n",
      "Epoch  27 Batch   40/78 - Train Accuracy:  0.983, Validation Accuracy:  0.951, Loss:  0.062\n",
      "Epoch  27 Batch   41/78 - Train Accuracy:  0.973, Validation Accuracy:  0.956, Loss:  0.073\n",
      "Epoch  27 Batch   42/78 - Train Accuracy:  0.990, Validation Accuracy:  0.959, Loss:  0.060\n",
      "Epoch  27 Batch   43/78 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.079\n",
      "Epoch  27 Batch   44/78 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.068\n",
      "Epoch  27 Batch   45/78 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  0.071\n",
      "Epoch  27 Batch   46/78 - Train Accuracy:  0.993, Validation Accuracy:  0.958, Loss:  0.062\n",
      "Epoch  27 Batch   47/78 - Train Accuracy:  0.989, Validation Accuracy:  0.956, Loss:  0.057\n",
      "Epoch  27 Batch   48/78 - Train Accuracy:  0.988, Validation Accuracy:  0.955, Loss:  0.054\n",
      "Epoch  27 Batch   49/78 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.074\n",
      "Epoch  27 Batch   50/78 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.075\n",
      "Epoch  27 Batch   51/78 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  0.054\n",
      "Epoch  27 Batch   52/78 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  0.063\n",
      "Epoch  27 Batch   53/78 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  0.054\n",
      "Epoch  27 Batch   54/78 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  0.066\n",
      "Epoch  27 Batch   55/78 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  0.062\n",
      "Epoch  27 Batch   56/78 - Train Accuracy:  0.983, Validation Accuracy:  0.964, Loss:  0.066\n",
      "Epoch  27 Batch   57/78 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  0.071\n",
      "Epoch  27 Batch   58/78 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  0.077\n",
      "Epoch  27 Batch   59/78 - Train Accuracy:  0.989, Validation Accuracy:  0.969, Loss:  0.057\n",
      "Epoch  27 Batch   60/78 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  0.063\n",
      "Epoch  27 Batch   61/78 - Train Accuracy:  0.964, Validation Accuracy:  0.967, Loss:  0.067\n",
      "Epoch  27 Batch   62/78 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  0.075\n",
      "Epoch  27 Batch   63/78 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  0.066\n",
      "Epoch  27 Batch   64/78 - Train Accuracy:  0.970, Validation Accuracy:  0.980, Loss:  0.060\n",
      "Epoch  27 Batch   65/78 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  0.066\n",
      "Epoch  27 Batch   66/78 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  0.053\n",
      "Epoch  27 Batch   67/78 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  0.058\n",
      "Epoch  27 Batch   68/78 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  0.067\n",
      "Epoch  27 Batch   69/78 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  0.053\n",
      "Epoch  27 Batch   70/78 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  0.070\n",
      "Epoch  27 Batch   71/78 - Train Accuracy:  0.992, Validation Accuracy:  0.969, Loss:  0.050\n",
      "Epoch  27 Batch   72/78 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  0.064\n",
      "Epoch  27 Batch   73/78 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  0.063\n",
      "Epoch  27 Batch   74/78 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  0.071\n",
      "Epoch  27 Batch   75/78 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  0.052\n",
      "Epoch  27 Batch   76/78 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  0.065\n",
      "Epoch  28 Batch    0/78 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  0.062\n",
      "Epoch  28 Batch    1/78 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  0.048\n",
      "Epoch  28 Batch    2/78 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  0.049\n",
      "Epoch  28 Batch    3/78 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.064\n",
      "Epoch  28 Batch    4/78 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  0.055\n",
      "Epoch  28 Batch    5/78 - Train Accuracy:  0.970, Validation Accuracy:  0.974, Loss:  0.055\n",
      "Epoch  28 Batch    6/78 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  0.053\n",
      "Epoch  28 Batch    7/78 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  0.062\n",
      "Epoch  28 Batch    8/78 - Train Accuracy:  0.994, Validation Accuracy:  0.963, Loss:  0.049\n",
      "Epoch  28 Batch    9/78 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  0.057\n",
      "Epoch  28 Batch   10/78 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  0.055\n",
      "Epoch  28 Batch   11/78 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  0.066\n",
      "Epoch  28 Batch   12/78 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  0.062\n",
      "Epoch  28 Batch   13/78 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.060\n",
      "Epoch  28 Batch   14/78 - Train Accuracy:  0.978, Validation Accuracy:  0.960, Loss:  0.046\n",
      "Epoch  28 Batch   15/78 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  0.072\n",
      "Epoch  28 Batch   16/78 - Train Accuracy:  0.989, Validation Accuracy:  0.967, Loss:  0.053\n",
      "Epoch  28 Batch   17/78 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  0.054\n",
      "Epoch  28 Batch   18/78 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.062\n",
      "Epoch  28 Batch   19/78 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  0.059\n",
      "Epoch  28 Batch   20/78 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  0.041\n",
      "Epoch  28 Batch   21/78 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  0.063\n",
      "Epoch  28 Batch   22/78 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  0.057\n",
      "Epoch  28 Batch   23/78 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  0.059\n",
      "Epoch  28 Batch   24/78 - Train Accuracy:  0.988, Validation Accuracy:  0.967, Loss:  0.047\n",
      "Epoch  28 Batch   25/78 - Train Accuracy:  0.993, Validation Accuracy:  0.970, Loss:  0.052\n",
      "Epoch  28 Batch   26/78 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  0.070\n",
      "Epoch  28 Batch   27/78 - Train Accuracy:  0.991, Validation Accuracy:  0.961, Loss:  0.057\n",
      "Epoch  28 Batch   28/78 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.064\n",
      "Epoch  28 Batch   29/78 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  0.069\n",
      "Epoch  28 Batch   30/78 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  0.061\n",
      "Epoch  28 Batch   31/78 - Train Accuracy:  0.965, Validation Accuracy:  0.970, Loss:  0.055\n",
      "Epoch  28 Batch   32/78 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  0.059\n",
      "Epoch  28 Batch   33/78 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.079\n",
      "Epoch  28 Batch   34/78 - Train Accuracy:  0.989, Validation Accuracy:  0.965, Loss:  0.057\n",
      "Epoch  28 Batch   35/78 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  0.063\n",
      "Epoch  28 Batch   36/78 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  0.058\n",
      "Epoch  28 Batch   37/78 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  0.062\n",
      "Epoch  28 Batch   38/78 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  0.059\n",
      "Epoch  28 Batch   39/78 - Train Accuracy:  0.978, Validation Accuracy:  0.954, Loss:  0.065\n",
      "Epoch  28 Batch   40/78 - Train Accuracy:  0.991, Validation Accuracy:  0.955, Loss:  0.053\n",
      "Epoch  28 Batch   41/78 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.067\n",
      "Epoch  28 Batch   42/78 - Train Accuracy:  0.988, Validation Accuracy:  0.956, Loss:  0.057\n",
      "Epoch  28 Batch   43/78 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  0.073\n",
      "Epoch  28 Batch   44/78 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  0.062\n",
      "Epoch  28 Batch   45/78 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  0.066\n",
      "Epoch  28 Batch   46/78 - Train Accuracy:  0.996, Validation Accuracy:  0.961, Loss:  0.057\n",
      "Epoch  28 Batch   47/78 - Train Accuracy:  0.993, Validation Accuracy:  0.956, Loss:  0.050\n",
      "Epoch  28 Batch   48/78 - Train Accuracy:  0.984, Validation Accuracy:  0.960, Loss:  0.050\n",
      "Epoch  28 Batch   49/78 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  0.070\n",
      "Epoch  28 Batch   50/78 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  0.070\n",
      "Epoch  28 Batch   51/78 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  0.048\n",
      "Epoch  28 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  0.058\n",
      "Epoch  28 Batch   53/78 - Train Accuracy:  0.990, Validation Accuracy:  0.967, Loss:  0.050\n",
      "Epoch  28 Batch   54/78 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.062\n",
      "Epoch  28 Batch   55/78 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  0.058\n",
      "Epoch  28 Batch   56/78 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  0.060\n",
      "Epoch  28 Batch   57/78 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  0.065\n",
      "Epoch  28 Batch   58/78 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  0.070\n",
      "Epoch  28 Batch   59/78 - Train Accuracy:  0.990, Validation Accuracy:  0.973, Loss:  0.053\n",
      "Epoch  28 Batch   60/78 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  0.058\n",
      "Epoch  28 Batch   61/78 - Train Accuracy:  0.968, Validation Accuracy:  0.967, Loss:  0.060\n",
      "Epoch  28 Batch   62/78 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  0.067\n",
      "Epoch  28 Batch   63/78 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  0.061\n",
      "Epoch  28 Batch   64/78 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  0.057\n",
      "Epoch  28 Batch   65/78 - Train Accuracy:  0.975, Validation Accuracy:  0.978, Loss:  0.060\n",
      "Epoch  28 Batch   66/78 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  28 Batch   67/78 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  0.052\n",
      "Epoch  28 Batch   68/78 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  0.063\n",
      "Epoch  28 Batch   69/78 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  0.049\n",
      "Epoch  28 Batch   70/78 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  0.064\n",
      "Epoch  28 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.969, Loss:  0.044\n",
      "Epoch  28 Batch   72/78 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  0.059\n",
      "Epoch  28 Batch   73/78 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  0.059\n",
      "Epoch  28 Batch   74/78 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  0.065\n",
      "Epoch  28 Batch   75/78 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  28 Batch   76/78 - Train Accuracy:  0.967, Validation Accuracy:  0.974, Loss:  0.059\n",
      "Epoch  29 Batch    0/78 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  0.056\n",
      "Epoch  29 Batch    1/78 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  0.044\n",
      "Epoch  29 Batch    2/78 - Train Accuracy:  0.983, Validation Accuracy:  0.962, Loss:  0.045\n",
      "Epoch  29 Batch    3/78 - Train Accuracy:  0.967, Validation Accuracy:  0.971, Loss:  0.058\n",
      "Epoch  29 Batch    4/78 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  0.050\n",
      "Epoch  29 Batch    5/78 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  0.049\n",
      "Epoch  29 Batch    6/78 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  0.050\n",
      "Epoch  29 Batch    7/78 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  0.055\n",
      "Epoch  29 Batch    8/78 - Train Accuracy:  0.997, Validation Accuracy:  0.969, Loss:  0.044\n",
      "Epoch  29 Batch    9/78 - Train Accuracy:  0.979, Validation Accuracy:  0.960, Loss:  0.051\n",
      "Epoch  29 Batch   10/78 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  0.051\n",
      "Epoch  29 Batch   11/78 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  0.063\n",
      "Epoch  29 Batch   12/78 - Train Accuracy:  0.987, Validation Accuracy:  0.962, Loss:  0.058\n",
      "Epoch  29 Batch   13/78 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  0.054\n",
      "Epoch  29 Batch   14/78 - Train Accuracy:  0.980, Validation Accuracy:  0.961, Loss:  0.042\n",
      "Epoch  29 Batch   15/78 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  0.068\n",
      "Epoch  29 Batch   16/78 - Train Accuracy:  0.988, Validation Accuracy:  0.968, Loss:  0.051\n",
      "Epoch  29 Batch   17/78 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.049\n",
      "Epoch  29 Batch   18/78 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  0.058\n",
      "Epoch  29 Batch   19/78 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  0.054\n",
      "Epoch  29 Batch   20/78 - Train Accuracy:  0.992, Validation Accuracy:  0.965, Loss:  0.039\n",
      "Epoch  29 Batch   21/78 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  0.057\n",
      "Epoch  29 Batch   22/78 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  0.054\n",
      "Epoch  29 Batch   23/78 - Train Accuracy:  0.985, Validation Accuracy:  0.962, Loss:  0.053\n",
      "Epoch  29 Batch   24/78 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  0.044\n",
      "Epoch  29 Batch   25/78 - Train Accuracy:  0.993, Validation Accuracy:  0.969, Loss:  0.048\n",
      "Epoch  29 Batch   26/78 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  0.066\n",
      "Epoch  29 Batch   27/78 - Train Accuracy:  0.992, Validation Accuracy:  0.964, Loss:  0.051\n",
      "Epoch  29 Batch   28/78 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  0.058\n",
      "Epoch  29 Batch   29/78 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  0.064\n",
      "Epoch  29 Batch   30/78 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  0.058\n",
      "Epoch  29 Batch   31/78 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  0.051\n",
      "Epoch  29 Batch   32/78 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  0.052\n",
      "Epoch  29 Batch   33/78 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  0.070\n",
      "Epoch  29 Batch   34/78 - Train Accuracy:  0.989, Validation Accuracy:  0.963, Loss:  0.054\n",
      "Epoch  29 Batch   35/78 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.059\n",
      "Epoch  29 Batch   36/78 - Train Accuracy:  0.981, Validation Accuracy:  0.960, Loss:  0.054\n",
      "Epoch  29 Batch   37/78 - Train Accuracy:  0.975, Validation Accuracy:  0.954, Loss:  0.054\n",
      "Epoch  29 Batch   38/78 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  0.055\n",
      "Epoch  29 Batch   39/78 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  0.063\n",
      "Epoch  29 Batch   40/78 - Train Accuracy:  0.990, Validation Accuracy:  0.956, Loss:  0.050\n",
      "Epoch  29 Batch   41/78 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  0.061\n",
      "Epoch  29 Batch   42/78 - Train Accuracy:  0.987, Validation Accuracy:  0.956, Loss:  0.052\n",
      "Epoch  29 Batch   43/78 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.068\n",
      "Epoch  29 Batch   44/78 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  0.057\n",
      "Epoch  29 Batch   45/78 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  0.062\n",
      "Epoch  29 Batch   46/78 - Train Accuracy:  0.997, Validation Accuracy:  0.964, Loss:  0.055\n",
      "Epoch  29 Batch   47/78 - Train Accuracy:  0.993, Validation Accuracy:  0.965, Loss:  0.046\n",
      "Epoch  29 Batch   48/78 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  0.046\n",
      "Epoch  29 Batch   49/78 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.066\n",
      "Epoch  29 Batch   50/78 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.068\n",
      "Epoch  29 Batch   51/78 - Train Accuracy:  0.984, Validation Accuracy:  0.965, Loss:  0.044\n",
      "Epoch  29 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  0.053\n",
      "Epoch  29 Batch   53/78 - Train Accuracy:  0.994, Validation Accuracy:  0.965, Loss:  0.047\n",
      "Epoch  29 Batch   54/78 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.060\n",
      "Epoch  29 Batch   55/78 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  0.057\n",
      "Epoch  29 Batch   56/78 - Train Accuracy:  0.990, Validation Accuracy:  0.965, Loss:  0.056\n",
      "Epoch  29 Batch   57/78 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  0.059\n",
      "Epoch  29 Batch   58/78 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  0.066\n",
      "Epoch  29 Batch   59/78 - Train Accuracy:  0.990, Validation Accuracy:  0.974, Loss:  0.052\n",
      "Epoch  29 Batch   60/78 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  0.055\n",
      "Epoch  29 Batch   61/78 - Train Accuracy:  0.968, Validation Accuracy:  0.971, Loss:  0.056\n",
      "Epoch  29 Batch   62/78 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  0.061\n",
      "Epoch  29 Batch   63/78 - Train Accuracy:  0.968, Validation Accuracy:  0.975, Loss:  0.058\n",
      "Epoch  29 Batch   64/78 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  0.056\n",
      "Epoch  29 Batch   65/78 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  0.057\n",
      "Epoch  29 Batch   66/78 - Train Accuracy:  0.973, Validation Accuracy:  0.977, Loss:  0.043\n",
      "Epoch  29 Batch   67/78 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  0.048\n",
      "Epoch  29 Batch   68/78 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  0.059\n",
      "Epoch  29 Batch   69/78 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  0.047\n",
      "Epoch  29 Batch   70/78 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  0.063\n",
      "Epoch  29 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.038\n",
      "Epoch  29 Batch   72/78 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  0.053\n",
      "Epoch  29 Batch   73/78 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  0.055\n",
      "Epoch  29 Batch   74/78 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  0.061\n",
      "Epoch  29 Batch   75/78 - Train Accuracy:  0.989, Validation Accuracy:  0.965, Loss:  0.045\n",
      "Epoch  29 Batch   76/78 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  0.053\n",
      "Epoch  30 Batch    0/78 - Train Accuracy:  0.983, Validation Accuracy:  0.977, Loss:  0.051\n",
      "Epoch  30 Batch    1/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.041\n",
      "Epoch  30 Batch    2/78 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  0.043\n",
      "Epoch  30 Batch    3/78 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  0.055\n",
      "Epoch  30 Batch    4/78 - Train Accuracy:  0.973, Validation Accuracy:  0.972, Loss:  0.045\n",
      "Epoch  30 Batch    5/78 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  0.044\n",
      "Epoch  30 Batch    6/78 - Train Accuracy:  0.990, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  30 Batch    7/78 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  0.052\n",
      "Epoch  30 Batch    8/78 - Train Accuracy:  0.998, Validation Accuracy:  0.969, Loss:  0.042\n",
      "Epoch  30 Batch    9/78 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  0.046\n",
      "Epoch  30 Batch   10/78 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  0.047\n",
      "Epoch  30 Batch   11/78 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  0.057\n",
      "Epoch  30 Batch   12/78 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  0.055\n",
      "Epoch  30 Batch   13/78 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  0.050\n",
      "Epoch  30 Batch   14/78 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  0.037\n",
      "Epoch  30 Batch   15/78 - Train Accuracy:  0.977, Validation Accuracy:  0.964, Loss:  0.061\n",
      "Epoch  30 Batch   16/78 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  0.048\n",
      "Epoch  30 Batch   17/78 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  0.045\n",
      "Epoch  30 Batch   18/78 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.053\n",
      "Epoch  30 Batch   19/78 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  0.047\n",
      "Epoch  30 Batch   20/78 - Train Accuracy:  0.994, Validation Accuracy:  0.962, Loss:  0.035\n",
      "Epoch  30 Batch   21/78 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  0.052\n",
      "Epoch  30 Batch   22/78 - Train Accuracy:  0.982, Validation Accuracy:  0.965, Loss:  0.052\n",
      "Epoch  30 Batch   23/78 - Train Accuracy:  0.988, Validation Accuracy:  0.965, Loss:  0.047\n",
      "Epoch  30 Batch   24/78 - Train Accuracy:  0.991, Validation Accuracy:  0.970, Loss:  0.039\n",
      "Epoch  30 Batch   25/78 - Train Accuracy:  0.993, Validation Accuracy:  0.962, Loss:  0.042\n",
      "Epoch  30 Batch   26/78 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  0.061\n",
      "Epoch  30 Batch   27/78 - Train Accuracy:  0.993, Validation Accuracy:  0.973, Loss:  0.046\n",
      "Epoch  30 Batch   28/78 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  0.051\n",
      "Epoch  30 Batch   29/78 - Train Accuracy:  0.985, Validation Accuracy:  0.967, Loss:  0.054\n",
      "Epoch  30 Batch   30/78 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  0.051\n",
      "Epoch  30 Batch   31/78 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  30 Batch   32/78 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  0.048\n",
      "Epoch  30 Batch   33/78 - Train Accuracy:  0.967, Validation Accuracy:  0.971, Loss:  0.061\n",
      "Epoch  30 Batch   34/78 - Train Accuracy:  0.990, Validation Accuracy:  0.967, Loss:  0.045\n",
      "Epoch  30 Batch   35/78 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.055\n",
      "Epoch  30 Batch   36/78 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  0.051\n",
      "Epoch  30 Batch   37/78 - Train Accuracy:  0.985, Validation Accuracy:  0.962, Loss:  0.049\n",
      "Epoch  30 Batch   38/78 - Train Accuracy:  0.979, Validation Accuracy:  0.958, Loss:  0.047\n",
      "Epoch  30 Batch   39/78 - Train Accuracy:  0.988, Validation Accuracy:  0.963, Loss:  0.056\n",
      "Epoch  30 Batch   40/78 - Train Accuracy:  0.990, Validation Accuracy:  0.962, Loss:  0.045\n",
      "Epoch  30 Batch   41/78 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  0.057\n",
      "Epoch  30 Batch   42/78 - Train Accuracy:  0.992, Validation Accuracy:  0.960, Loss:  0.046\n",
      "Epoch  30 Batch   43/78 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  0.062\n",
      "Epoch  30 Batch   44/78 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  0.050\n",
      "Epoch  30 Batch   45/78 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  0.056\n",
      "Epoch  30 Batch   46/78 - Train Accuracy:  0.997, Validation Accuracy:  0.962, Loss:  0.052\n",
      "Epoch  30 Batch   47/78 - Train Accuracy:  0.998, Validation Accuracy:  0.971, Loss:  0.042\n",
      "Epoch  30 Batch   48/78 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  0.041\n",
      "Epoch  30 Batch   49/78 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  0.057\n",
      "Epoch  30 Batch   50/78 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  0.065\n",
      "Epoch  30 Batch   51/78 - Train Accuracy:  0.985, Validation Accuracy:  0.955, Loss:  0.040\n",
      "Epoch  30 Batch   52/78 - Train Accuracy:  0.978, Validation Accuracy:  0.958, Loss:  0.047\n",
      "Epoch  30 Batch   53/78 - Train Accuracy:  0.994, Validation Accuracy:  0.967, Loss:  0.041\n",
      "Epoch  30 Batch   54/78 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  0.052\n",
      "Epoch  30 Batch   55/78 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  0.053\n",
      "Epoch  30 Batch   56/78 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  0.055\n",
      "Epoch  30 Batch   57/78 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  0.055\n",
      "Epoch  30 Batch   58/78 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  0.055\n",
      "Epoch  30 Batch   59/78 - Train Accuracy:  0.990, Validation Accuracy:  0.970, Loss:  0.047\n",
      "Epoch  30 Batch   60/78 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  0.053\n",
      "Epoch  30 Batch   61/78 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  0.054\n",
      "Epoch  30 Batch   62/78 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  0.055\n",
      "Epoch  30 Batch   63/78 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  0.053\n",
      "Epoch  30 Batch   64/78 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  0.051\n",
      "Epoch  30 Batch   65/78 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  0.057\n",
      "Epoch  30 Batch   66/78 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  0.040\n",
      "Epoch  30 Batch   67/78 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  0.042\n",
      "Epoch  30 Batch   68/78 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  0.054\n",
      "Epoch  30 Batch   69/78 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  0.043\n",
      "Epoch  30 Batch   70/78 - Train Accuracy:  0.960, Validation Accuracy:  0.973, Loss:  0.063\n",
      "Epoch  30 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.968, Loss:  0.036\n",
      "Epoch  30 Batch   72/78 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  0.048\n",
      "Epoch  30 Batch   73/78 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  0.049\n",
      "Epoch  30 Batch   74/78 - Train Accuracy:  0.988, Validation Accuracy:  0.967, Loss:  0.055\n",
      "Epoch  30 Batch   75/78 - Train Accuracy:  0.987, Validation Accuracy:  0.964, Loss:  0.041\n",
      "Epoch  30 Batch   76/78 - Train Accuracy:  0.984, Validation Accuracy:  0.965, Loss:  0.050\n",
      "Epoch  31 Batch    0/78 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  0.045\n",
      "Epoch  31 Batch    1/78 - Train Accuracy:  0.988, Validation Accuracy:  0.981, Loss:  0.035\n",
      "Epoch  31 Batch    2/78 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  0.040\n",
      "Epoch  31 Batch    3/78 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  0.051\n",
      "Epoch  31 Batch    4/78 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  0.041\n",
      "Epoch  31 Batch    5/78 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  0.040\n",
      "Epoch  31 Batch    6/78 - Train Accuracy:  0.999, Validation Accuracy:  0.970, Loss:  0.042\n",
      "Epoch  31 Batch    7/78 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  0.047\n",
      "Epoch  31 Batch    8/78 - Train Accuracy:  0.998, Validation Accuracy:  0.969, Loss:  0.038\n",
      "Epoch  31 Batch    9/78 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  0.043\n",
      "Epoch  31 Batch   10/78 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  0.043\n",
      "Epoch  31 Batch   11/78 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  0.050\n",
      "Epoch  31 Batch   12/78 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  0.049\n",
      "Epoch  31 Batch   13/78 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  0.046\n",
      "Epoch  31 Batch   14/78 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  0.033\n",
      "Epoch  31 Batch   15/78 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  0.055\n",
      "Epoch  31 Batch   16/78 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  0.044\n",
      "Epoch  31 Batch   17/78 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  0.041\n",
      "Epoch  31 Batch   18/78 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  0.049\n",
      "Epoch  31 Batch   19/78 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  0.041\n",
      "Epoch  31 Batch   20/78 - Train Accuracy:  0.994, Validation Accuracy:  0.964, Loss:  0.032\n",
      "Epoch  31 Batch   21/78 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  0.046\n",
      "Epoch  31 Batch   22/78 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  0.047\n",
      "Epoch  31 Batch   23/78 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  0.042\n",
      "Epoch  31 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.970, Loss:  0.036\n",
      "Epoch  31 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.971, Loss:  0.037\n",
      "Epoch  31 Batch   26/78 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  0.052\n",
      "Epoch  31 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.042\n",
      "Epoch  31 Batch   28/78 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  31 Batch   29/78 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  0.049\n",
      "Epoch  31 Batch   30/78 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  0.044\n",
      "Epoch  31 Batch   31/78 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  0.041\n",
      "Epoch  31 Batch   32/78 - Train Accuracy:  0.991, Validation Accuracy:  0.975, Loss:  0.043\n",
      "Epoch  31 Batch   33/78 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  0.055\n",
      "Epoch  31 Batch   34/78 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  0.040\n",
      "Epoch  31 Batch   35/78 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  0.050\n",
      "Epoch  31 Batch   36/78 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  0.046\n",
      "Epoch  31 Batch   37/78 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  0.045\n",
      "Epoch  31 Batch   38/78 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  0.041\n",
      "Epoch  31 Batch   39/78 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  0.048\n",
      "Epoch  31 Batch   40/78 - Train Accuracy:  0.992, Validation Accuracy:  0.967, Loss:  0.038\n",
      "Epoch  31 Batch   41/78 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  0.050\n",
      "Epoch  31 Batch   42/78 - Train Accuracy:  0.992, Validation Accuracy:  0.967, Loss:  0.040\n",
      "Epoch  31 Batch   43/78 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  0.057\n",
      "Epoch  31 Batch   44/78 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  0.044\n",
      "Epoch  31 Batch   45/78 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  0.047\n",
      "Epoch  31 Batch   46/78 - Train Accuracy:  0.996, Validation Accuracy:  0.964, Loss:  0.043\n",
      "Epoch  31 Batch   47/78 - Train Accuracy:  0.998, Validation Accuracy:  0.968, Loss:  0.039\n",
      "Epoch  31 Batch   48/78 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  0.039\n",
      "Epoch  31 Batch   49/78 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  0.049\n",
      "Epoch  31 Batch   50/78 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  0.056\n",
      "Epoch  31 Batch   51/78 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  0.036\n",
      "Epoch  31 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  0.043\n",
      "Epoch  31 Batch   53/78 - Train Accuracy:  0.989, Validation Accuracy:  0.959, Loss:  0.036\n",
      "Epoch  31 Batch   54/78 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  0.045\n",
      "Epoch  31 Batch   55/78 - Train Accuracy:  0.991, Validation Accuracy:  0.959, Loss:  0.046\n",
      "Epoch  31 Batch   56/78 - Train Accuracy:  0.990, Validation Accuracy:  0.964, Loss:  0.050\n",
      "Epoch  31 Batch   57/78 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  0.051\n",
      "Epoch  31 Batch   58/78 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  0.049\n",
      "Epoch  31 Batch   59/78 - Train Accuracy:  0.990, Validation Accuracy:  0.972, Loss:  0.039\n",
      "Epoch  31 Batch   60/78 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  0.043\n",
      "Epoch  31 Batch   61/78 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  0.048\n",
      "Epoch  31 Batch   62/78 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.052\n",
      "Epoch  31 Batch   63/78 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  0.047\n",
      "Epoch  31 Batch   64/78 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  0.040\n",
      "Epoch  31 Batch   65/78 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  0.052\n",
      "Epoch  31 Batch   66/78 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  0.038\n",
      "Epoch  31 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.971, Loss:  0.037\n",
      "Epoch  31 Batch   68/78 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.043\n",
      "Epoch  31 Batch   69/78 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  0.038\n",
      "Epoch  31 Batch   70/78 - Train Accuracy:  0.965, Validation Accuracy:  0.977, Loss:  0.057\n",
      "Epoch  31 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.033\n",
      "Epoch  31 Batch   72/78 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  0.043\n",
      "Epoch  31 Batch   73/78 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  0.048\n",
      "Epoch  31 Batch   74/78 - Train Accuracy:  0.990, Validation Accuracy:  0.973, Loss:  0.048\n",
      "Epoch  31 Batch   75/78 - Train Accuracy:  0.991, Validation Accuracy:  0.965, Loss:  0.034\n",
      "Epoch  31 Batch   76/78 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  0.048\n",
      "Epoch  32 Batch    0/78 - Train Accuracy:  0.991, Validation Accuracy:  0.960, Loss:  0.042\n",
      "Epoch  32 Batch    1/78 - Train Accuracy:  0.991, Validation Accuracy:  0.968, Loss:  0.033\n",
      "Epoch  32 Batch    2/78 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  0.038\n",
      "Epoch  32 Batch    3/78 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  0.046\n",
      "Epoch  32 Batch    4/78 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  0.037\n",
      "Epoch  32 Batch    5/78 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  0.038\n",
      "Epoch  32 Batch    6/78 - Train Accuracy:  0.999, Validation Accuracy:  0.969, Loss:  0.038\n",
      "Epoch  32 Batch    7/78 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  0.044\n",
      "Epoch  32 Batch    8/78 - Train Accuracy:  0.997, Validation Accuracy:  0.968, Loss:  0.035\n",
      "Epoch  32 Batch    9/78 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  0.040\n",
      "Epoch  32 Batch   10/78 - Train Accuracy:  0.989, Validation Accuracy:  0.961, Loss:  0.041\n",
      "Epoch  32 Batch   11/78 - Train Accuracy:  0.989, Validation Accuracy:  0.970, Loss:  0.049\n",
      "Epoch  32 Batch   12/78 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  0.045\n",
      "Epoch  32 Batch   13/78 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  0.042\n",
      "Epoch  32 Batch   14/78 - Train Accuracy:  0.993, Validation Accuracy:  0.972, Loss:  0.032\n",
      "Epoch  32 Batch   15/78 - Train Accuracy:  0.985, Validation Accuracy:  0.967, Loss:  0.054\n",
      "Epoch  32 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.969, Loss:  0.039\n",
      "Epoch  32 Batch   17/78 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  0.036\n",
      "Epoch  32 Batch   18/78 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  0.046\n",
      "Epoch  32 Batch   19/78 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  0.040\n",
      "Epoch  32 Batch   20/78 - Train Accuracy:  0.997, Validation Accuracy:  0.968, Loss:  0.029\n",
      "Epoch  32 Batch   21/78 - Train Accuracy:  0.990, Validation Accuracy:  0.970, Loss:  0.043\n",
      "Epoch  32 Batch   22/78 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  0.043\n",
      "Epoch  32 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.969, Loss:  0.040\n",
      "Epoch  32 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.969, Loss:  0.033\n",
      "Epoch  32 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.969, Loss:  0.035\n",
      "Epoch  32 Batch   26/78 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  0.048\n",
      "Epoch  32 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.038\n",
      "Epoch  32 Batch   28/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.043\n",
      "Epoch  32 Batch   29/78 - Train Accuracy:  0.989, Validation Accuracy:  0.973, Loss:  0.044\n",
      "Epoch  32 Batch   30/78 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  0.041\n",
      "Epoch  32 Batch   31/78 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  0.037\n",
      "Epoch  32 Batch   32/78 - Train Accuracy:  0.990, Validation Accuracy:  0.974, Loss:  0.039\n",
      "Epoch  32 Batch   33/78 - Train Accuracy:  0.970, Validation Accuracy:  0.974, Loss:  0.051\n",
      "Epoch  32 Batch   34/78 - Train Accuracy:  0.991, Validation Accuracy:  0.974, Loss:  0.036\n",
      "Epoch  32 Batch   35/78 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  0.046\n",
      "Epoch  32 Batch   36/78 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  0.042\n",
      "Epoch  32 Batch   37/78 - Train Accuracy:  0.989, Validation Accuracy:  0.968, Loss:  0.041\n",
      "Epoch  32 Batch   38/78 - Train Accuracy:  0.998, Validation Accuracy:  0.968, Loss:  0.037\n",
      "Epoch  32 Batch   39/78 - Train Accuracy:  0.988, Validation Accuracy:  0.968, Loss:  0.043\n",
      "Epoch  32 Batch   40/78 - Train Accuracy:  0.992, Validation Accuracy:  0.968, Loss:  0.036\n",
      "Epoch  32 Batch   41/78 - Train Accuracy:  0.990, Validation Accuracy:  0.970, Loss:  0.047\n",
      "Epoch  32 Batch   42/78 - Train Accuracy:  0.992, Validation Accuracy:  0.968, Loss:  0.036\n",
      "Epoch  32 Batch   43/78 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  0.052\n",
      "Epoch  32 Batch   44/78 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  0.041\n",
      "Epoch  32 Batch   45/78 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  0.043\n",
      "Epoch  32 Batch   46/78 - Train Accuracy:  0.997, Validation Accuracy:  0.968, Loss:  0.038\n",
      "Epoch  32 Batch   47/78 - Train Accuracy:  0.998, Validation Accuracy:  0.968, Loss:  0.035\n",
      "Epoch  32 Batch   48/78 - Train Accuracy:  0.990, Validation Accuracy:  0.970, Loss:  0.035\n",
      "Epoch  32 Batch   49/78 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  0.045\n",
      "Epoch  32 Batch   50/78 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  0.052\n",
      "Epoch  32 Batch   51/78 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  0.032\n",
      "Epoch  32 Batch   52/78 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  0.038\n",
      "Epoch  32 Batch   53/78 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  0.034\n",
      "Epoch  32 Batch   54/78 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  0.042\n",
      "Epoch  32 Batch   55/78 - Train Accuracy:  0.993, Validation Accuracy:  0.969, Loss:  0.040\n",
      "Epoch  32 Batch   56/78 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  0.044\n",
      "Epoch  32 Batch   57/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.046\n",
      "Epoch  32 Batch   58/78 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  0.047\n",
      "Epoch  32 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.970, Loss:  0.036\n",
      "Epoch  32 Batch   60/78 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  0.038\n",
      "Epoch  32 Batch   61/78 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  0.042\n",
      "Epoch  32 Batch   62/78 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  0.047\n",
      "Epoch  32 Batch   63/78 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  0.043\n",
      "Epoch  32 Batch   64/78 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  0.036\n",
      "Epoch  32 Batch   65/78 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  0.046\n",
      "Epoch  32 Batch   66/78 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  0.034\n",
      "Epoch  32 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.971, Loss:  0.035\n",
      "Epoch  32 Batch   68/78 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  0.040\n",
      "Epoch  32 Batch   69/78 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  0.034\n",
      "Epoch  32 Batch   70/78 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  0.050\n",
      "Epoch  32 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.972, Loss:  0.030\n",
      "Epoch  32 Batch   72/78 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  0.039\n",
      "Epoch  32 Batch   73/78 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  0.041\n",
      "Epoch  32 Batch   74/78 - Train Accuracy:  0.992, Validation Accuracy:  0.972, Loss:  0.043\n",
      "Epoch  32 Batch   75/78 - Train Accuracy:  0.996, Validation Accuracy:  0.972, Loss:  0.032\n",
      "Epoch  32 Batch   76/78 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  0.044\n",
      "Epoch  33 Batch    0/78 - Train Accuracy:  0.987, Validation Accuracy:  0.975, Loss:  0.037\n",
      "Epoch  33 Batch    1/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  33 Batch    2/78 - Train Accuracy:  0.990, Validation Accuracy:  0.974, Loss:  0.036\n",
      "Epoch  33 Batch    3/78 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  0.045\n",
      "Epoch  33 Batch    4/78 - Train Accuracy:  0.977, Validation Accuracy:  0.979, Loss:  0.034\n",
      "Epoch  33 Batch    5/78 - Train Accuracy:  0.973, Validation Accuracy:  0.978, Loss:  0.034\n",
      "Epoch  33 Batch    6/78 - Train Accuracy:  0.994, Validation Accuracy:  0.977, Loss:  0.034\n",
      "Epoch  33 Batch    7/78 - Train Accuracy:  0.990, Validation Accuracy:  0.980, Loss:  0.040\n",
      "Epoch  33 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.032\n",
      "Epoch  33 Batch    9/78 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  0.037\n",
      "Epoch  33 Batch   10/78 - Train Accuracy:  0.989, Validation Accuracy:  0.964, Loss:  0.038\n",
      "Epoch  33 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.967, Loss:  0.046\n",
      "Epoch  33 Batch   12/78 - Train Accuracy:  0.987, Validation Accuracy:  0.973, Loss:  0.040\n",
      "Epoch  33 Batch   13/78 - Train Accuracy:  0.992, Validation Accuracy:  0.970, Loss:  0.037\n",
      "Epoch  33 Batch   14/78 - Train Accuracy:  0.991, Validation Accuracy:  0.970, Loss:  0.029\n",
      "Epoch  33 Batch   15/78 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  0.046\n",
      "Epoch  33 Batch   16/78 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  0.037\n",
      "Epoch  33 Batch   17/78 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  0.034\n",
      "Epoch  33 Batch   18/78 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  0.041\n",
      "Epoch  33 Batch   19/78 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  0.035\n",
      "Epoch  33 Batch   20/78 - Train Accuracy:  0.997, Validation Accuracy:  0.971, Loss:  0.028\n",
      "Epoch  33 Batch   21/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.042\n",
      "Epoch  33 Batch   22/78 - Train Accuracy:  0.989, Validation Accuracy:  0.972, Loss:  0.039\n",
      "Epoch  33 Batch   23/78 - Train Accuracy:  0.994, Validation Accuracy:  0.967, Loss:  0.038\n",
      "Epoch  33 Batch   24/78 - Train Accuracy:  0.997, Validation Accuracy:  0.970, Loss:  0.031\n",
      "Epoch  33 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.972, Loss:  0.034\n",
      "Epoch  33 Batch   26/78 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  0.045\n",
      "Epoch  33 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.972, Loss:  0.034\n",
      "Epoch  33 Batch   28/78 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  0.039\n",
      "Epoch  33 Batch   29/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.041\n",
      "Epoch  33 Batch   30/78 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  0.038\n",
      "Epoch  33 Batch   31/78 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  0.034\n",
      "Epoch  33 Batch   32/78 - Train Accuracy:  0.997, Validation Accuracy:  0.974, Loss:  0.035\n",
      "Epoch  33 Batch   33/78 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  0.048\n",
      "Epoch  33 Batch   34/78 - Train Accuracy:  0.998, Validation Accuracy:  0.973, Loss:  0.033\n",
      "Epoch  33 Batch   35/78 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  0.041\n",
      "Epoch  33 Batch   36/78 - Train Accuracy:  0.987, Validation Accuracy:  0.973, Loss:  0.038\n",
      "Epoch  33 Batch   37/78 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  0.038\n",
      "Epoch  33 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.032\n",
      "Epoch  33 Batch   39/78 - Train Accuracy:  0.985, Validation Accuracy:  0.977, Loss:  0.039\n",
      "Epoch  33 Batch   40/78 - Train Accuracy:  0.997, Validation Accuracy:  0.972, Loss:  0.032\n",
      "Epoch  33 Batch   41/78 - Train Accuracy:  0.988, Validation Accuracy:  0.972, Loss:  0.042\n",
      "Epoch  33 Batch   42/78 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  33 Batch   43/78 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  0.047\n",
      "Epoch  33 Batch   44/78 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  0.037\n",
      "Epoch  33 Batch   45/78 - Train Accuracy:  0.987, Validation Accuracy:  0.978, Loss:  0.038\n",
      "Epoch  33 Batch   46/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.033\n",
      "Epoch  33 Batch   47/78 - Train Accuracy:  0.998, Validation Accuracy:  0.974, Loss:  0.032\n",
      "Epoch  33 Batch   48/78 - Train Accuracy:  0.991, Validation Accuracy:  0.970, Loss:  0.030\n",
      "Epoch  33 Batch   49/78 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  0.042\n",
      "Epoch  33 Batch   50/78 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  0.046\n",
      "Epoch  33 Batch   51/78 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  0.029\n",
      "Epoch  33 Batch   52/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.035\n",
      "Epoch  33 Batch   53/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  33 Batch   54/78 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  0.039\n",
      "Epoch  33 Batch   55/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.036\n",
      "Epoch  33 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.038\n",
      "Epoch  33 Batch   57/78 - Train Accuracy:  0.989, Validation Accuracy:  0.977, Loss:  0.041\n",
      "Epoch  33 Batch   58/78 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  0.042\n",
      "Epoch  33 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.972, Loss:  0.033\n",
      "Epoch  33 Batch   60/78 - Train Accuracy:  0.980, Validation Accuracy:  0.974, Loss:  0.035\n",
      "Epoch  33 Batch   61/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.036\n",
      "Epoch  33 Batch   62/78 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  0.042\n",
      "Epoch  33 Batch   63/78 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  0.039\n",
      "Epoch  33 Batch   64/78 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  0.033\n",
      "Epoch  33 Batch   65/78 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  0.041\n",
      "Epoch  33 Batch   66/78 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  0.031\n",
      "Epoch  33 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.975, Loss:  0.032\n",
      "Epoch  33 Batch   68/78 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  0.036\n",
      "Epoch  33 Batch   69/78 - Train Accuracy:  0.989, Validation Accuracy:  0.982, Loss:  0.032\n",
      "Epoch  33 Batch   70/78 - Train Accuracy:  0.972, Validation Accuracy:  0.982, Loss:  0.045\n",
      "Epoch  33 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  33 Batch   72/78 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  0.035\n",
      "Epoch  33 Batch   73/78 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  0.039\n",
      "Epoch  33 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.039\n",
      "Epoch  33 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.028\n",
      "Epoch  33 Batch   76/78 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  0.040\n",
      "Epoch  34 Batch    0/78 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  0.034\n",
      "Epoch  34 Batch    1/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  34 Batch    2/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  34 Batch    3/78 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  0.040\n",
      "Epoch  34 Batch    4/78 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  0.033\n",
      "Epoch  34 Batch    5/78 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  0.031\n",
      "Epoch  34 Batch    6/78 - Train Accuracy:  0.994, Validation Accuracy:  0.974, Loss:  0.030\n",
      "Epoch  34 Batch    7/78 - Train Accuracy:  0.992, Validation Accuracy:  0.975, Loss:  0.035\n",
      "Epoch  34 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.029\n",
      "Epoch  34 Batch    9/78 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  0.034\n",
      "Epoch  34 Batch   10/78 - Train Accuracy:  0.992, Validation Accuracy:  0.971, Loss:  0.032\n",
      "Epoch  34 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.971, Loss:  0.038\n",
      "Epoch  34 Batch   12/78 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  0.036\n",
      "Epoch  34 Batch   13/78 - Train Accuracy:  0.994, Validation Accuracy:  0.972, Loss:  0.033\n",
      "Epoch  34 Batch   14/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  34 Batch   15/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.041\n",
      "Epoch  34 Batch   16/78 - Train Accuracy:  0.992, Validation Accuracy:  0.973, Loss:  0.034\n",
      "Epoch  34 Batch   17/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.031\n",
      "Epoch  34 Batch   18/78 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  0.037\n",
      "Epoch  34 Batch   19/78 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  34 Batch   20/78 - Train Accuracy:  0.994, Validation Accuracy:  0.972, Loss:  0.025\n",
      "Epoch  34 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.039\n",
      "Epoch  34 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.975, Loss:  0.037\n",
      "Epoch  34 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.972, Loss:  0.035\n",
      "Epoch  34 Batch   24/78 - Train Accuracy:  0.997, Validation Accuracy:  0.972, Loss:  0.027\n",
      "Epoch  34 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.972, Loss:  0.031\n",
      "Epoch  34 Batch   26/78 - Train Accuracy:  0.989, Validation Accuracy:  0.977, Loss:  0.042\n",
      "Epoch  34 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.031\n",
      "Epoch  34 Batch   28/78 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  0.035\n",
      "Epoch  34 Batch   29/78 - Train Accuracy:  0.989, Validation Accuracy:  0.967, Loss:  0.039\n",
      "Epoch  34 Batch   30/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.037\n",
      "Epoch  34 Batch   31/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.032\n",
      "Epoch  34 Batch   32/78 - Train Accuracy:  0.992, Validation Accuracy:  0.974, Loss:  0.033\n",
      "Epoch  34 Batch   33/78 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  0.044\n",
      "Epoch  34 Batch   34/78 - Train Accuracy:  0.998, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  34 Batch   35/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.038\n",
      "Epoch  34 Batch   36/78 - Train Accuracy:  0.989, Validation Accuracy:  0.973, Loss:  0.035\n",
      "Epoch  34 Batch   37/78 - Train Accuracy:  0.993, Validation Accuracy:  0.973, Loss:  0.035\n",
      "Epoch  34 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.030\n",
      "Epoch  34 Batch   39/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.036\n",
      "Epoch  34 Batch   40/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  34 Batch   41/78 - Train Accuracy:  0.992, Validation Accuracy:  0.977, Loss:  0.039\n",
      "Epoch  34 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  34 Batch   43/78 - Train Accuracy:  0.983, Validation Accuracy:  0.978, Loss:  0.043\n",
      "Epoch  34 Batch   44/78 - Train Accuracy:  0.989, Validation Accuracy:  0.979, Loss:  0.034\n",
      "Epoch  34 Batch   45/78 - Train Accuracy:  0.987, Validation Accuracy:  0.979, Loss:  0.036\n",
      "Epoch  34 Batch   46/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.030\n",
      "Epoch  34 Batch   47/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  34 Batch   48/78 - Train Accuracy:  0.994, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  34 Batch   49/78 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  0.040\n",
      "Epoch  34 Batch   50/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.041\n",
      "Epoch  34 Batch   51/78 - Train Accuracy:  0.997, Validation Accuracy:  0.973, Loss:  0.027\n",
      "Epoch  34 Batch   52/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  34 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.974, Loss:  0.026\n",
      "Epoch  34 Batch   54/78 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  0.036\n",
      "Epoch  34 Batch   55/78 - Train Accuracy:  0.992, Validation Accuracy:  0.974, Loss:  0.033\n",
      "Epoch  34 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.971, Loss:  0.035\n",
      "Epoch  34 Batch   57/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.038\n",
      "Epoch  34 Batch   58/78 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  0.038\n",
      "Epoch  34 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.974, Loss:  0.030\n",
      "Epoch  34 Batch   60/78 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  34 Batch   61/78 - Train Accuracy:  0.993, Validation Accuracy:  0.973, Loss:  0.033\n",
      "Epoch  34 Batch   62/78 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  0.039\n",
      "Epoch  34 Batch   63/78 - Train Accuracy:  0.983, Validation Accuracy:  0.980, Loss:  0.035\n",
      "Epoch  34 Batch   64/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.031\n",
      "Epoch  34 Batch   65/78 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  0.037\n",
      "Epoch  34 Batch   66/78 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  0.028\n",
      "Epoch  34 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  34 Batch   68/78 - Train Accuracy:  0.975, Validation Accuracy:  0.978, Loss:  0.033\n",
      "Epoch  34 Batch   69/78 - Train Accuracy:  0.989, Validation Accuracy:  0.980, Loss:  0.029\n",
      "Epoch  34 Batch   70/78 - Train Accuracy:  0.977, Validation Accuracy:  0.985, Loss:  0.043\n",
      "Epoch  34 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.980, Loss:  0.024\n",
      "Epoch  34 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.032\n",
      "Epoch  34 Batch   73/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.036\n",
      "Epoch  34 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.035\n",
      "Epoch  34 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.025\n",
      "Epoch  34 Batch   76/78 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  0.036\n",
      "Epoch  35 Batch    0/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  35 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.972, Loss:  0.024\n",
      "Epoch  35 Batch    2/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  35 Batch    3/78 - Train Accuracy:  0.979, Validation Accuracy:  0.978, Loss:  0.036\n",
      "Epoch  35 Batch    4/78 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  0.030\n",
      "Epoch  35 Batch    5/78 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  0.028\n",
      "Epoch  35 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.028\n",
      "Epoch  35 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.031\n",
      "Epoch  35 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  35 Batch    9/78 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  35 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.972, Loss:  0.030\n",
      "Epoch  35 Batch   11/78 - Train Accuracy:  0.998, Validation Accuracy:  0.971, Loss:  0.035\n",
      "Epoch  35 Batch   12/78 - Train Accuracy:  0.990, Validation Accuracy:  0.979, Loss:  0.033\n",
      "Epoch  35 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.030\n",
      "Epoch  35 Batch   14/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.024\n",
      "Epoch  35 Batch   15/78 - Train Accuracy:  0.987, Validation Accuracy:  0.978, Loss:  0.037\n",
      "Epoch  35 Batch   16/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.032\n",
      "Epoch  35 Batch   17/78 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  0.028\n",
      "Epoch  35 Batch   18/78 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  0.034\n",
      "Epoch  35 Batch   19/78 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  0.028\n",
      "Epoch  35 Batch   20/78 - Train Accuracy:  0.994, Validation Accuracy:  0.972, Loss:  0.023\n",
      "Epoch  35 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.036\n",
      "Epoch  35 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.036\n",
      "Epoch  35 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.972, Loss:  0.031\n",
      "Epoch  35 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  35 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.972, Loss:  0.028\n",
      "Epoch  35 Batch   26/78 - Train Accuracy:  0.989, Validation Accuracy:  0.977, Loss:  0.038\n",
      "Epoch  35 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.029\n",
      "Epoch  35 Batch   28/78 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  0.033\n",
      "Epoch  35 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.969, Loss:  0.035\n",
      "Epoch  35 Batch   30/78 - Train Accuracy:  0.991, Validation Accuracy:  0.975, Loss:  0.034\n",
      "Epoch  35 Batch   31/78 - Train Accuracy:  0.997, Validation Accuracy:  0.973, Loss:  0.030\n",
      "Epoch  35 Batch   32/78 - Train Accuracy:  0.997, Validation Accuracy:  0.974, Loss:  0.030\n",
      "Epoch  35 Batch   33/78 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  0.041\n",
      "Epoch  35 Batch   34/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  35 Batch   35/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.035\n",
      "Epoch  35 Batch   36/78 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  35 Batch   37/78 - Train Accuracy:  0.994, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  35 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  35 Batch   39/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.033\n",
      "Epoch  35 Batch   40/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.026\n",
      "Epoch  35 Batch   41/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.036\n",
      "Epoch  35 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.027\n",
      "Epoch  35 Batch   43/78 - Train Accuracy:  0.983, Validation Accuracy:  0.978, Loss:  0.040\n",
      "Epoch  35 Batch   44/78 - Train Accuracy:  0.989, Validation Accuracy:  0.978, Loss:  0.032\n",
      "Epoch  35 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.979, Loss:  0.033\n",
      "Epoch  35 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.027\n",
      "Epoch  35 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.026\n",
      "Epoch  35 Batch   48/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  35 Batch   49/78 - Train Accuracy:  0.977, Validation Accuracy:  0.977, Loss:  0.037\n",
      "Epoch  35 Batch   50/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.037\n",
      "Epoch  35 Batch   51/78 - Train Accuracy:  0.997, Validation Accuracy:  0.974, Loss:  0.025\n",
      "Epoch  35 Batch   52/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.029\n",
      "Epoch  35 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  35 Batch   54/78 - Train Accuracy:  0.984, Validation Accuracy:  0.979, Loss:  0.033\n",
      "Epoch  35 Batch   55/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  35 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.973, Loss:  0.032\n",
      "Epoch  35 Batch   57/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.035\n",
      "Epoch  35 Batch   58/78 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  0.034\n",
      "Epoch  35 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.027\n",
      "Epoch  35 Batch   60/78 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  35 Batch   61/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.030\n",
      "Epoch  35 Batch   62/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.035\n",
      "Epoch  35 Batch   63/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.032\n",
      "Epoch  35 Batch   64/78 - Train Accuracy:  0.988, Validation Accuracy:  0.980, Loss:  0.028\n",
      "Epoch  35 Batch   65/78 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  0.034\n",
      "Epoch  35 Batch   66/78 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  0.026\n",
      "Epoch  35 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  35 Batch   68/78 - Train Accuracy:  0.975, Validation Accuracy:  0.980, Loss:  0.030\n",
      "Epoch  35 Batch   69/78 - Train Accuracy:  0.989, Validation Accuracy:  0.987, Loss:  0.027\n",
      "Epoch  35 Batch   70/78 - Train Accuracy:  0.982, Validation Accuracy:  0.985, Loss:  0.040\n",
      "Epoch  35 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.022\n",
      "Epoch  35 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.030\n",
      "Epoch  35 Batch   73/78 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.033\n",
      "Epoch  35 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.033\n",
      "Epoch  35 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  35 Batch   76/78 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  0.033\n",
      "Epoch  36 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  36 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.977, Loss:  0.023\n",
      "Epoch  36 Batch    2/78 - Train Accuracy:  0.998, Validation Accuracy:  0.978, Loss:  0.024\n",
      "Epoch  36 Batch    3/78 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  0.033\n",
      "Epoch  36 Batch    4/78 - Train Accuracy:  0.992, Validation Accuracy:  0.970, Loss:  0.028\n",
      "Epoch  36 Batch    5/78 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  0.026\n",
      "Epoch  36 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.026\n",
      "Epoch  36 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  36 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.972, Loss:  0.024\n",
      "Epoch  36 Batch    9/78 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  36 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  36 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.033\n",
      "Epoch  36 Batch   12/78 - Train Accuracy:  0.990, Validation Accuracy:  0.987, Loss:  0.030\n",
      "Epoch  36 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.028\n",
      "Epoch  36 Batch   14/78 - Train Accuracy:  0.992, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  36 Batch   15/78 - Train Accuracy:  0.987, Validation Accuracy:  0.978, Loss:  0.034\n",
      "Epoch  36 Batch   16/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.030\n",
      "Epoch  36 Batch   17/78 - Train Accuracy:  0.988, Validation Accuracy:  0.979, Loss:  0.026\n",
      "Epoch  36 Batch   18/78 - Train Accuracy:  0.992, Validation Accuracy:  0.980, Loss:  0.032\n",
      "Epoch  36 Batch   19/78 - Train Accuracy:  0.991, Validation Accuracy:  0.974, Loss:  0.026\n",
      "Epoch  36 Batch   20/78 - Train Accuracy:  0.998, Validation Accuracy:  0.973, Loss:  0.022\n",
      "Epoch  36 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.033\n",
      "Epoch  36 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.033\n",
      "Epoch  36 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.977, Loss:  0.029\n",
      "Epoch  36 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.972, Loss:  0.022\n",
      "Epoch  36 Batch   25/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  36 Batch   26/78 - Train Accuracy:  0.989, Validation Accuracy:  0.975, Loss:  0.035\n",
      "Epoch  36 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.969, Loss:  0.026\n",
      "Epoch  36 Batch   28/78 - Train Accuracy:  0.984, Validation Accuracy:  0.979, Loss:  0.030\n",
      "Epoch  36 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.968, Loss:  0.033\n",
      "Epoch  36 Batch   30/78 - Train Accuracy:  0.991, Validation Accuracy:  0.975, Loss:  0.031\n",
      "Epoch  36 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.027\n",
      "Epoch  36 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.028\n",
      "Epoch  36 Batch   33/78 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  0.038\n",
      "Epoch  36 Batch   34/78 - Train Accuracy:  0.998, Validation Accuracy:  0.971, Loss:  0.026\n",
      "Epoch  36 Batch   35/78 - Train Accuracy:  0.985, Validation Accuracy:  0.977, Loss:  0.033\n",
      "Epoch  36 Batch   36/78 - Train Accuracy:  0.991, Validation Accuracy:  0.974, Loss:  0.029\n",
      "Epoch  36 Batch   37/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.029\n",
      "Epoch  36 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  36 Batch   39/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.030\n",
      "Epoch  36 Batch   40/78 - Train Accuracy:  0.997, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  36 Batch   41/78 - Train Accuracy:  0.999, Validation Accuracy:  0.977, Loss:  0.033\n",
      "Epoch  36 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.025\n",
      "Epoch  36 Batch   43/78 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  0.037\n",
      "Epoch  36 Batch   44/78 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  0.029\n",
      "Epoch  36 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.030\n",
      "Epoch  36 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.025\n",
      "Epoch  36 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.024\n",
      "Epoch  36 Batch   48/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  36 Batch   49/78 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  0.034\n",
      "Epoch  36 Batch   50/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.034\n",
      "Epoch  36 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.023\n",
      "Epoch  36 Batch   52/78 - Train Accuracy:  0.988, Validation Accuracy:  0.973, Loss:  0.027\n",
      "Epoch  36 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.022\n",
      "Epoch  36 Batch   54/78 - Train Accuracy:  0.984, Validation Accuracy:  0.979, Loss:  0.030\n",
      "Epoch  36 Batch   55/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.027\n",
      "Epoch  36 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.979, Loss:  0.029\n",
      "Epoch  36 Batch   57/78 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  0.032\n",
      "Epoch  36 Batch   58/78 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  0.031\n",
      "Epoch  36 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  36 Batch   60/78 - Train Accuracy:  0.985, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  36 Batch   61/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.027\n",
      "Epoch  36 Batch   62/78 - Train Accuracy:  0.985, Validation Accuracy:  0.984, Loss:  0.032\n",
      "Epoch  36 Batch   63/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.029\n",
      "Epoch  36 Batch   64/78 - Train Accuracy:  0.990, Validation Accuracy:  0.981, Loss:  0.026\n",
      "Epoch  36 Batch   65/78 - Train Accuracy:  0.984, Validation Accuracy:  0.980, Loss:  0.031\n",
      "Epoch  36 Batch   66/78 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  36 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.980, Loss:  0.024\n",
      "Epoch  36 Batch   68/78 - Train Accuracy:  0.987, Validation Accuracy:  0.980, Loss:  0.028\n",
      "Epoch  36 Batch   69/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.025\n",
      "Epoch  36 Batch   70/78 - Train Accuracy:  0.982, Validation Accuracy:  0.985, Loss:  0.037\n",
      "Epoch  36 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.020\n",
      "Epoch  36 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.027\n",
      "Epoch  36 Batch   73/78 - Train Accuracy:  0.985, Validation Accuracy:  0.988, Loss:  0.030\n",
      "Epoch  36 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.030\n",
      "Epoch  36 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.021\n",
      "Epoch  36 Batch   76/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.030\n",
      "Epoch  37 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  37 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  37 Batch    2/78 - Train Accuracy:  0.997, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  37 Batch    3/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.031\n",
      "Epoch  37 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.968, Loss:  0.026\n",
      "Epoch  37 Batch    5/78 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  0.024\n",
      "Epoch  37 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.970, Loss:  0.024\n",
      "Epoch  37 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.027\n",
      "Epoch  37 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.022\n",
      "Epoch  37 Batch    9/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.026\n",
      "Epoch  37 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.026\n",
      "Epoch  37 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.031\n",
      "Epoch  37 Batch   12/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.028\n",
      "Epoch  37 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.026\n",
      "Epoch  37 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.978, Loss:  0.021\n",
      "Epoch  37 Batch   15/78 - Train Accuracy:  0.987, Validation Accuracy:  0.978, Loss:  0.032\n",
      "Epoch  37 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.028\n",
      "Epoch  37 Batch   17/78 - Train Accuracy:  0.991, Validation Accuracy:  0.979, Loss:  0.024\n",
      "Epoch  37 Batch   18/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.030\n",
      "Epoch  37 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.024\n",
      "Epoch  37 Batch   20/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.020\n",
      "Epoch  37 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.031\n",
      "Epoch  37 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.031\n",
      "Epoch  37 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.027\n",
      "Epoch  37 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.021\n",
      "Epoch  37 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.025\n",
      "Epoch  37 Batch   26/78 - Train Accuracy:  0.991, Validation Accuracy:  0.979, Loss:  0.033\n",
      "Epoch  37 Batch   27/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.024\n",
      "Epoch  37 Batch   28/78 - Train Accuracy:  0.984, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  37 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.030\n",
      "Epoch  37 Batch   30/78 - Train Accuracy:  0.991, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  37 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  37 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  37 Batch   33/78 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  0.035\n",
      "Epoch  37 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.971, Loss:  0.024\n",
      "Epoch  37 Batch   35/78 - Train Accuracy:  0.984, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  37 Batch   36/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  37 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.027\n",
      "Epoch  37 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  37 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.028\n",
      "Epoch  37 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.023\n",
      "Epoch  37 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.030\n",
      "Epoch  37 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.023\n",
      "Epoch  37 Batch   43/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.034\n",
      "Epoch  37 Batch   44/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  37 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.028\n",
      "Epoch  37 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  37 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.022\n",
      "Epoch  37 Batch   48/78 - Train Accuracy:  0.994, Validation Accuracy:  0.977, Loss:  0.021\n",
      "Epoch  37 Batch   49/78 - Train Accuracy:  0.981, Validation Accuracy:  0.978, Loss:  0.032\n",
      "Epoch  37 Batch   50/78 - Train Accuracy:  0.990, Validation Accuracy:  0.975, Loss:  0.032\n",
      "Epoch  37 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.021\n",
      "Epoch  37 Batch   52/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.025\n",
      "Epoch  37 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.020\n",
      "Epoch  37 Batch   54/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  37 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.025\n",
      "Epoch  37 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.979, Loss:  0.027\n",
      "Epoch  37 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  37 Batch   58/78 - Train Accuracy:  0.993, Validation Accuracy:  0.978, Loss:  0.029\n",
      "Epoch  37 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  37 Batch   60/78 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  37 Batch   61/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  37 Batch   62/78 - Train Accuracy:  0.985, Validation Accuracy:  0.983, Loss:  0.030\n",
      "Epoch  37 Batch   63/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.027\n",
      "Epoch  37 Batch   64/78 - Train Accuracy:  0.990, Validation Accuracy:  0.980, Loss:  0.024\n",
      "Epoch  37 Batch   65/78 - Train Accuracy:  0.984, Validation Accuracy:  0.980, Loss:  0.029\n",
      "Epoch  37 Batch   66/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  37 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.983, Loss:  0.022\n",
      "Epoch  37 Batch   68/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.026\n",
      "Epoch  37 Batch   69/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.023\n",
      "Epoch  37 Batch   70/78 - Train Accuracy:  0.983, Validation Accuracy:  0.984, Loss:  0.035\n",
      "Epoch  37 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  37 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.025\n",
      "Epoch  37 Batch   73/78 - Train Accuracy:  0.985, Validation Accuracy:  0.988, Loss:  0.028\n",
      "Epoch  37 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.028\n",
      "Epoch  37 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.020\n",
      "Epoch  37 Batch   76/78 - Train Accuracy:  0.994, Validation Accuracy:  0.977, Loss:  0.028\n",
      "Epoch  38 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  38 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.020\n",
      "Epoch  38 Batch    2/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.022\n",
      "Epoch  38 Batch    3/78 - Train Accuracy:  0.989, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  38 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.970, Loss:  0.024\n",
      "Epoch  38 Batch    5/78 - Train Accuracy:  0.993, Validation Accuracy:  0.969, Loss:  0.022\n",
      "Epoch  38 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.972, Loss:  0.022\n",
      "Epoch  38 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  38 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  38 Batch    9/78 - Train Accuracy:  0.989, Validation Accuracy:  0.979, Loss:  0.025\n",
      "Epoch  38 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.977, Loss:  0.025\n",
      "Epoch  38 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.029\n",
      "Epoch  38 Batch   12/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.026\n",
      "Epoch  38 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.024\n",
      "Epoch  38 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.978, Loss:  0.019\n",
      "Epoch  38 Batch   15/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  38 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  38 Batch   17/78 - Train Accuracy:  0.991, Validation Accuracy:  0.982, Loss:  0.022\n",
      "Epoch  38 Batch   18/78 - Train Accuracy:  0.997, Validation Accuracy:  0.982, Loss:  0.028\n",
      "Epoch  38 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  38 Batch   20/78 - Train Accuracy:  0.998, Validation Accuracy:  0.978, Loss:  0.019\n",
      "Epoch  38 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.030\n",
      "Epoch  38 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.029\n",
      "Epoch  38 Batch   23/78 - Train Accuracy:  0.992, Validation Accuracy:  0.983, Loss:  0.025\n",
      "Epoch  38 Batch   24/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.019\n",
      "Epoch  38 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.023\n",
      "Epoch  38 Batch   26/78 - Train Accuracy:  0.990, Validation Accuracy:  0.979, Loss:  0.031\n",
      "Epoch  38 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  38 Batch   28/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  38 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.028\n",
      "Epoch  38 Batch   30/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.027\n",
      "Epoch  38 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  38 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  38 Batch   33/78 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  0.033\n",
      "Epoch  38 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.971, Loss:  0.022\n",
      "Epoch  38 Batch   35/78 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  0.028\n",
      "Epoch  38 Batch   36/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  38 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.025\n",
      "Epoch  38 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.021\n",
      "Epoch  38 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  38 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.021\n",
      "Epoch  38 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.028\n",
      "Epoch  38 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.022\n",
      "Epoch  38 Batch   43/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.031\n",
      "Epoch  38 Batch   44/78 - Train Accuracy:  0.993, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  38 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  38 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.021\n",
      "Epoch  38 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.020\n",
      "Epoch  38 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.020\n",
      "Epoch  38 Batch   49/78 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  0.030\n",
      "Epoch  38 Batch   50/78 - Train Accuracy:  0.990, Validation Accuracy:  0.975, Loss:  0.030\n",
      "Epoch  38 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.019\n",
      "Epoch  38 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.024\n",
      "Epoch  38 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.977, Loss:  0.019\n",
      "Epoch  38 Batch   54/78 - Train Accuracy:  0.991, Validation Accuracy:  0.981, Loss:  0.025\n",
      "Epoch  38 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.023\n",
      "Epoch  38 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.979, Loss:  0.025\n",
      "Epoch  38 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.977, Loss:  0.027\n",
      "Epoch  38 Batch   58/78 - Train Accuracy:  0.998, Validation Accuracy:  0.978, Loss:  0.027\n",
      "Epoch  38 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.982, Loss:  0.021\n",
      "Epoch  38 Batch   60/78 - Train Accuracy:  0.990, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  38 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.024\n",
      "Epoch  38 Batch   62/78 - Train Accuracy:  0.985, Validation Accuracy:  0.988, Loss:  0.028\n",
      "Epoch  38 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.025\n",
      "Epoch  38 Batch   64/78 - Train Accuracy:  0.990, Validation Accuracy:  0.987, Loss:  0.022\n",
      "Epoch  38 Batch   65/78 - Train Accuracy:  0.984, Validation Accuracy:  0.982, Loss:  0.027\n",
      "Epoch  38 Batch   66/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.020\n",
      "Epoch  38 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.020\n",
      "Epoch  38 Batch   68/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.024\n",
      "Epoch  38 Batch   69/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  38 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.984, Loss:  0.033\n",
      "Epoch  38 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.017\n",
      "Epoch  38 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.023\n",
      "Epoch  38 Batch   73/78 - Train Accuracy:  0.987, Validation Accuracy:  0.990, Loss:  0.025\n",
      "Epoch  38 Batch   74/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.026\n",
      "Epoch  38 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  38 Batch   76/78 - Train Accuracy:  0.999, Validation Accuracy:  0.982, Loss:  0.027\n",
      "Epoch  39 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.022\n",
      "Epoch  39 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.982, Loss:  0.019\n",
      "Epoch  39 Batch    2/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.020\n",
      "Epoch  39 Batch    3/78 - Train Accuracy:  0.991, Validation Accuracy:  0.974, Loss:  0.027\n",
      "Epoch  39 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.022\n",
      "Epoch  39 Batch    5/78 - Train Accuracy:  0.993, Validation Accuracy:  0.967, Loss:  0.020\n",
      "Epoch  39 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.972, Loss:  0.021\n",
      "Epoch  39 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  39 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.020\n",
      "Epoch  39 Batch    9/78 - Train Accuracy:  0.989, Validation Accuracy:  0.983, Loss:  0.023\n",
      "Epoch  39 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.023\n",
      "Epoch  39 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.027\n",
      "Epoch  39 Batch   12/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.024\n",
      "Epoch  39 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.022\n",
      "Epoch  39 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.018\n",
      "Epoch  39 Batch   15/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.027\n",
      "Epoch  39 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  39 Batch   17/78 - Train Accuracy:  0.999, Validation Accuracy:  0.982, Loss:  0.020\n",
      "Epoch  39 Batch   18/78 - Train Accuracy:  0.997, Validation Accuracy:  0.982, Loss:  0.026\n",
      "Epoch  39 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.021\n",
      "Epoch  39 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.017\n",
      "Epoch  39 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.027\n",
      "Epoch  39 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.028\n",
      "Epoch  39 Batch   23/78 - Train Accuracy:  0.992, Validation Accuracy:  0.982, Loss:  0.024\n",
      "Epoch  39 Batch   24/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  39 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.020\n",
      "Epoch  39 Batch   26/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.029\n",
      "Epoch  39 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.021\n",
      "Epoch  39 Batch   28/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  39 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.026\n",
      "Epoch  39 Batch   30/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.026\n",
      "Epoch  39 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.023\n",
      "Epoch  39 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.022\n",
      "Epoch  39 Batch   33/78 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  0.031\n",
      "Epoch  39 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.971, Loss:  0.021\n",
      "Epoch  39 Batch   35/78 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  0.027\n",
      "Epoch  39 Batch   36/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.024\n",
      "Epoch  39 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  39 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.020\n",
      "Epoch  39 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  39 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.020\n",
      "Epoch  39 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.027\n",
      "Epoch  39 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.020\n",
      "Epoch  39 Batch   43/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  39 Batch   44/78 - Train Accuracy:  0.993, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  39 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.981, Loss:  0.025\n",
      "Epoch  39 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.020\n",
      "Epoch  39 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.019\n",
      "Epoch  39 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.974, Loss:  0.018\n",
      "Epoch  39 Batch   49/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.028\n",
      "Epoch  39 Batch   50/78 - Train Accuracy:  0.990, Validation Accuracy:  0.975, Loss:  0.028\n",
      "Epoch  39 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.018\n",
      "Epoch  39 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.977, Loss:  0.022\n",
      "Epoch  39 Batch   53/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.017\n",
      "Epoch  39 Batch   54/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.024\n",
      "Epoch  39 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  39 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.024\n",
      "Epoch  39 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.025\n",
      "Epoch  39 Batch   58/78 - Train Accuracy:  0.998, Validation Accuracy:  0.982, Loss:  0.025\n",
      "Epoch  39 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.982, Loss:  0.020\n",
      "Epoch  39 Batch   60/78 - Train Accuracy:  0.990, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  39 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.022\n",
      "Epoch  39 Batch   62/78 - Train Accuracy:  0.987, Validation Accuracy:  0.988, Loss:  0.026\n",
      "Epoch  39 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.023\n",
      "Epoch  39 Batch   64/78 - Train Accuracy:  0.993, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  39 Batch   65/78 - Train Accuracy:  0.984, Validation Accuracy:  0.987, Loss:  0.026\n",
      "Epoch  39 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  39 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.978, Loss:  0.019\n",
      "Epoch  39 Batch   68/78 - Train Accuracy:  0.993, Validation Accuracy:  0.983, Loss:  0.022\n",
      "Epoch  39 Batch   69/78 - Train Accuracy:  0.998, Validation Accuracy:  0.983, Loss:  0.019\n",
      "Epoch  39 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.984, Loss:  0.030\n",
      "Epoch  39 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.016\n",
      "Epoch  39 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.021\n",
      "Epoch  39 Batch   73/78 - Train Accuracy:  0.990, Validation Accuracy:  0.990, Loss:  0.023\n",
      "Epoch  39 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.023\n",
      "Epoch  39 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  39 Batch   76/78 - Train Accuracy:  0.999, Validation Accuracy:  0.982, Loss:  0.026\n",
      "Epoch  40 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.020\n",
      "Epoch  40 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.017\n",
      "Epoch  40 Batch    2/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  40 Batch    3/78 - Train Accuracy:  0.992, Validation Accuracy:  0.980, Loss:  0.025\n",
      "Epoch  40 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.977, Loss:  0.020\n",
      "Epoch  40 Batch    5/78 - Train Accuracy:  0.993, Validation Accuracy:  0.967, Loss:  0.018\n",
      "Epoch  40 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.019\n",
      "Epoch  40 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.021\n",
      "Epoch  40 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.020\n",
      "Epoch  40 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.983, Loss:  0.021\n",
      "Epoch  40 Batch   10/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.021\n",
      "Epoch  40 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.025\n",
      "Epoch  40 Batch   12/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.023\n",
      "Epoch  40 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  40 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.017\n",
      "Epoch  40 Batch   15/78 - Train Accuracy:  0.988, Validation Accuracy:  0.985, Loss:  0.026\n",
      "Epoch  40 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.981, Loss:  0.024\n",
      "Epoch  40 Batch   17/78 - Train Accuracy:  0.999, Validation Accuracy:  0.982, Loss:  0.019\n",
      "Epoch  40 Batch   18/78 - Train Accuracy:  0.998, Validation Accuracy:  0.982, Loss:  0.024\n",
      "Epoch  40 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.020\n",
      "Epoch  40 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.016\n",
      "Epoch  40 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  0.025\n",
      "Epoch  40 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.026\n",
      "Epoch  40 Batch   23/78 - Train Accuracy:  0.992, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  40 Batch   24/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.017\n",
      "Epoch  40 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  40 Batch   26/78 - Train Accuracy:  0.994, Validation Accuracy:  0.989, Loss:  0.026\n",
      "Epoch  40 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  40 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.023\n",
      "Epoch  40 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.981, Loss:  0.024\n",
      "Epoch  40 Batch   30/78 - Train Accuracy:  0.996, Validation Accuracy:  0.974, Loss:  0.024\n",
      "Epoch  40 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  40 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.020\n",
      "Epoch  40 Batch   33/78 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  0.029\n",
      "Epoch  40 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.019\n",
      "Epoch  40 Batch   35/78 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  0.026\n",
      "Epoch  40 Batch   36/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.023\n",
      "Epoch  40 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.022\n",
      "Epoch  40 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  40 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.022\n",
      "Epoch  40 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.018\n",
      "Epoch  40 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.025\n",
      "Epoch  40 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.975, Loss:  0.019\n",
      "Epoch  40 Batch   43/78 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  0.027\n",
      "Epoch  40 Batch   44/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  40 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.980, Loss:  0.023\n",
      "Epoch  40 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.019\n",
      "Epoch  40 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.018\n",
      "Epoch  40 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.975, Loss:  0.017\n",
      "Epoch  40 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.971, Loss:  0.026\n",
      "Epoch  40 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.971, Loss:  0.026\n",
      "Epoch  40 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.017\n",
      "Epoch  40 Batch   52/78 - Train Accuracy:  0.994, Validation Accuracy:  0.974, Loss:  0.021\n",
      "Epoch  40 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.016\n",
      "Epoch  40 Batch   54/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  40 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  40 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.022\n",
      "Epoch  40 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.024\n",
      "Epoch  40 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  40 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  40 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  40 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.021\n",
      "Epoch  40 Batch   62/78 - Train Accuracy:  0.987, Validation Accuracy:  0.988, Loss:  0.024\n",
      "Epoch  40 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.022\n",
      "Epoch  40 Batch   64/78 - Train Accuracy:  0.998, Validation Accuracy:  0.991, Loss:  0.019\n",
      "Epoch  40 Batch   65/78 - Train Accuracy:  0.984, Validation Accuracy:  0.991, Loss:  0.024\n",
      "Epoch  40 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  40 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.017\n",
      "Epoch  40 Batch   68/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.021\n",
      "Epoch  40 Batch   69/78 - Train Accuracy:  0.998, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  40 Batch   70/78 - Train Accuracy:  0.988, Validation Accuracy:  0.984, Loss:  0.029\n",
      "Epoch  40 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  40 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  40 Batch   73/78 - Train Accuracy:  0.990, Validation Accuracy:  0.990, Loss:  0.021\n",
      "Epoch  40 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.022\n",
      "Epoch  40 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.016\n",
      "Epoch  40 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.984, Loss:  0.025\n",
      "Epoch  41 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.019\n",
      "Epoch  41 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.015\n",
      "Epoch  41 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.017\n",
      "Epoch  41 Batch    3/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.023\n",
      "Epoch  41 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  41 Batch    5/78 - Train Accuracy:  0.993, Validation Accuracy:  0.973, Loss:  0.017\n",
      "Epoch  41 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.018\n",
      "Epoch  41 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.019\n",
      "Epoch  41 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.020\n",
      "Epoch  41 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.020\n",
      "Epoch  41 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  41 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.024\n",
      "Epoch  41 Batch   12/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.021\n",
      "Epoch  41 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  41 Batch   14/78 - Train Accuracy:  0.996, Validation Accuracy:  0.988, Loss:  0.016\n",
      "Epoch  41 Batch   15/78 - Train Accuracy:  0.992, Validation Accuracy:  0.985, Loss:  0.024\n",
      "Epoch  41 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.985, Loss:  0.023\n",
      "Epoch  41 Batch   17/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  41 Batch   18/78 - Train Accuracy:  0.998, Validation Accuracy:  0.985, Loss:  0.023\n",
      "Epoch  41 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.019\n",
      "Epoch  41 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.015\n",
      "Epoch  41 Batch   21/78 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  0.023\n",
      "Epoch  41 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.983, Loss:  0.024\n",
      "Epoch  41 Batch   23/78 - Train Accuracy:  0.990, Validation Accuracy:  0.987, Loss:  0.022\n",
      "Epoch  41 Batch   24/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.016\n",
      "Epoch  41 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.017\n",
      "Epoch  41 Batch   26/78 - Train Accuracy:  0.994, Validation Accuracy:  0.989, Loss:  0.024\n",
      "Epoch  41 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  41 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.987, Loss:  0.021\n",
      "Epoch  41 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.981, Loss:  0.023\n",
      "Epoch  41 Batch   30/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  41 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.020\n",
      "Epoch  41 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.019\n",
      "Epoch  41 Batch   33/78 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  0.027\n",
      "Epoch  41 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.017\n",
      "Epoch  41 Batch   35/78 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  41 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.021\n",
      "Epoch  41 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.021\n",
      "Epoch  41 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  41 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.021\n",
      "Epoch  41 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.979, Loss:  0.017\n",
      "Epoch  41 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.024\n",
      "Epoch  41 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.980, Loss:  0.018\n",
      "Epoch  41 Batch   43/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.025\n",
      "Epoch  41 Batch   44/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.019\n",
      "Epoch  41 Batch   45/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  41 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  41 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  41 Batch   48/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.016\n",
      "Epoch  41 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.975, Loss:  0.024\n",
      "Epoch  41 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.971, Loss:  0.024\n",
      "Epoch  41 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.970, Loss:  0.016\n",
      "Epoch  41 Batch   52/78 - Train Accuracy:  0.994, Validation Accuracy:  0.974, Loss:  0.020\n",
      "Epoch  41 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.016\n",
      "Epoch  41 Batch   54/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  41 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  41 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  41 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.022\n",
      "Epoch  41 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.022\n",
      "Epoch  41 Batch   59/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  41 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  41 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.020\n",
      "Epoch  41 Batch   62/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.022\n",
      "Epoch  41 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.020\n",
      "Epoch  41 Batch   64/78 - Train Accuracy:  0.998, Validation Accuracy:  0.991, Loss:  0.017\n",
      "Epoch  41 Batch   65/78 - Train Accuracy:  0.992, Validation Accuracy:  0.990, Loss:  0.022\n",
      "Epoch  41 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  41 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  41 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  41 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.017\n",
      "Epoch  41 Batch   70/78 - Train Accuracy:  0.988, Validation Accuracy:  0.983, Loss:  0.027\n",
      "Epoch  41 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  41 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  41 Batch   73/78 - Train Accuracy:  0.989, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  41 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  41 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  41 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.987, Loss:  0.023\n",
      "Epoch  42 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  42 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  42 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  42 Batch    3/78 - Train Accuracy:  0.996, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  42 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.018\n",
      "Epoch  42 Batch    5/78 - Train Accuracy:  0.997, Validation Accuracy:  0.981, Loss:  0.016\n",
      "Epoch  42 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.016\n",
      "Epoch  42 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.017\n",
      "Epoch  42 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.018\n",
      "Epoch  42 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.977, Loss:  0.019\n",
      "Epoch  42 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  42 Batch   11/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.022\n",
      "Epoch  42 Batch   12/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  42 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  42 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  42 Batch   15/78 - Train Accuracy:  0.992, Validation Accuracy:  0.985, Loss:  0.024\n",
      "Epoch  42 Batch   16/78 - Train Accuracy:  0.991, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  42 Batch   17/78 - Train Accuracy:  0.999, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  42 Batch   18/78 - Train Accuracy:  0.998, Validation Accuracy:  0.985, Loss:  0.022\n",
      "Epoch  42 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  42 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.014\n",
      "Epoch  42 Batch   21/78 - Train Accuracy:  0.989, Validation Accuracy:  0.982, Loss:  0.021\n",
      "Epoch  42 Batch   22/78 - Train Accuracy:  0.994, Validation Accuracy:  0.982, Loss:  0.023\n",
      "Epoch  42 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  42 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  42 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.015\n",
      "Epoch  42 Batch   26/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.022\n",
      "Epoch  42 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  42 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  42 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  42 Batch   30/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.021\n",
      "Epoch  42 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.018\n",
      "Epoch  42 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.018\n",
      "Epoch  42 Batch   33/78 - Train Accuracy:  0.982, Validation Accuracy:  0.978, Loss:  0.025\n",
      "Epoch  42 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.016\n",
      "Epoch  42 Batch   35/78 - Train Accuracy:  0.989, Validation Accuracy:  0.973, Loss:  0.022\n",
      "Epoch  42 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.020\n",
      "Epoch  42 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.020\n",
      "Epoch  42 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.018\n",
      "Epoch  42 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.020\n",
      "Epoch  42 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.015\n",
      "Epoch  42 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.022\n",
      "Epoch  42 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.978, Loss:  0.018\n",
      "Epoch  42 Batch   43/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.024\n",
      "Epoch  42 Batch   44/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.018\n",
      "Epoch  42 Batch   45/78 - Train Accuracy:  0.998, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  42 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  42 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  42 Batch   48/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.015\n",
      "Epoch  42 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.980, Loss:  0.023\n",
      "Epoch  42 Batch   50/78 - Train Accuracy:  0.992, Validation Accuracy:  0.975, Loss:  0.023\n",
      "Epoch  42 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.015\n",
      "Epoch  42 Batch   52/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.019\n",
      "Epoch  42 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.014\n",
      "Epoch  42 Batch   54/78 - Train Accuracy:  0.996, Validation Accuracy:  0.980, Loss:  0.019\n",
      "Epoch  42 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.017\n",
      "Epoch  42 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.019\n",
      "Epoch  42 Batch   57/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.021\n",
      "Epoch  42 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.021\n",
      "Epoch  42 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  42 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  42 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  42 Batch   62/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  42 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.992, Loss:  0.020\n",
      "Epoch  42 Batch   64/78 - Train Accuracy:  0.998, Validation Accuracy:  0.991, Loss:  0.016\n",
      "Epoch  42 Batch   65/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.020\n",
      "Epoch  42 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  42 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  42 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  42 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  42 Batch   70/78 - Train Accuracy:  0.988, Validation Accuracy:  0.987, Loss:  0.025\n",
      "Epoch  42 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  42 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  42 Batch   73/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  42 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  42 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.013\n",
      "Epoch  42 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.989, Loss:  0.021\n",
      "Epoch  43 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  43 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  43 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  43 Batch    3/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  43 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.016\n",
      "Epoch  43 Batch    5/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  43 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.015\n",
      "Epoch  43 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.973, Loss:  0.016\n",
      "Epoch  43 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.015\n",
      "Epoch  43 Batch    9/78 - Train Accuracy:  0.994, Validation Accuracy:  0.982, Loss:  0.017\n",
      "Epoch  43 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.017\n",
      "Epoch  43 Batch   11/78 - Train Accuracy:  0.998, Validation Accuracy:  0.989, Loss:  0.020\n",
      "Epoch  43 Batch   12/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  43 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  43 Batch   14/78 - Train Accuracy:  0.999, Validation Accuracy:  0.983, Loss:  0.013\n",
      "Epoch  43 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.022\n",
      "Epoch  43 Batch   16/78 - Train Accuracy:  0.990, Validation Accuracy:  0.983, Loss:  0.023\n",
      "Epoch  43 Batch   17/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  43 Batch   18/78 - Train Accuracy:  0.998, Validation Accuracy:  0.985, Loss:  0.020\n",
      "Epoch  43 Batch   19/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  43 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.017\n",
      "Epoch  43 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.020\n",
      "Epoch  43 Batch   22/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.020\n",
      "Epoch  43 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.020\n",
      "Epoch  43 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  43 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  43 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  43 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.989, Loss:  0.016\n",
      "Epoch  43 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  43 Batch   29/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.021\n",
      "Epoch  43 Batch   30/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  43 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  43 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  43 Batch   33/78 - Train Accuracy:  0.981, Validation Accuracy:  0.983, Loss:  0.023\n",
      "Epoch  43 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.015\n",
      "Epoch  43 Batch   35/78 - Train Accuracy:  0.989, Validation Accuracy:  0.974, Loss:  0.020\n",
      "Epoch  43 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.975, Loss:  0.018\n",
      "Epoch  43 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.973, Loss:  0.019\n",
      "Epoch  43 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.979, Loss:  0.018\n",
      "Epoch  43 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  43 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.015\n",
      "Epoch  43 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.020\n",
      "Epoch  43 Batch   42/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.016\n",
      "Epoch  43 Batch   43/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.023\n",
      "Epoch  43 Batch   44/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  43 Batch   45/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  43 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  43 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  43 Batch   48/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  43 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  43 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  43 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.014\n",
      "Epoch  43 Batch   52/78 - Train Accuracy:  0.994, Validation Accuracy:  0.982, Loss:  0.018\n",
      "Epoch  43 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.014\n",
      "Epoch  43 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.018\n",
      "Epoch  43 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  43 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  43 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.019\n",
      "Epoch  43 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.020\n",
      "Epoch  43 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  43 Batch   60/78 - Train Accuracy:  0.990, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  43 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.016\n",
      "Epoch  43 Batch   62/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.019\n",
      "Epoch  43 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.019\n",
      "Epoch  43 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.016\n",
      "Epoch  43 Batch   65/78 - Train Accuracy:  0.992, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  43 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  43 Batch   67/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  43 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  43 Batch   69/78 - Train Accuracy:  0.997, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  43 Batch   70/78 - Train Accuracy:  0.991, Validation Accuracy:  0.990, Loss:  0.025\n",
      "Epoch  43 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  43 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.016\n",
      "Epoch  43 Batch   73/78 - Train Accuracy:  0.993, Validation Accuracy:  0.989, Loss:  0.017\n",
      "Epoch  43 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.018\n",
      "Epoch  43 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  43 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  44 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  44 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  44 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.014\n",
      "Epoch  44 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  44 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  44 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  44 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.014\n",
      "Epoch  44 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.016\n",
      "Epoch  44 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.014\n",
      "Epoch  44 Batch    9/78 - Train Accuracy:  0.994, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  44 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  44 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  44 Batch   12/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.017\n",
      "Epoch  44 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  44 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  44 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.019\n",
      "Epoch  44 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.018\n",
      "Epoch  44 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  44 Batch   18/78 - Train Accuracy:  0.998, Validation Accuracy:  0.985, Loss:  0.020\n",
      "Epoch  44 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  44 Batch   20/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  44 Batch   21/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  44 Batch   22/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.022\n",
      "Epoch  44 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  44 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  44 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.014\n",
      "Epoch  44 Batch   26/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.030\n",
      "Epoch  44 Batch   27/78 - Train Accuracy:  0.992, Validation Accuracy:  0.982, Loss:  0.015\n",
      "Epoch  44 Batch   28/78 - Train Accuracy:  0.992, Validation Accuracy:  0.988, Loss:  0.039\n",
      "Epoch  44 Batch   29/78 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  0.019\n",
      "Epoch  44 Batch   30/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.094\n",
      "Epoch  44 Batch   31/78 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.017\n",
      "Epoch  44 Batch   32/78 - Train Accuracy:  0.985, Validation Accuracy:  0.960, Loss:  0.151\n",
      "Epoch  44 Batch   33/78 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  0.080\n",
      "Epoch  44 Batch   34/78 - Train Accuracy:  0.974, Validation Accuracy:  0.960, Loss:  0.266\n",
      "Epoch  44 Batch   35/78 - Train Accuracy:  0.961, Validation Accuracy:  0.944, Loss:  0.100\n",
      "Epoch  44 Batch   36/78 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  0.107\n",
      "Epoch  44 Batch   37/78 - Train Accuracy:  0.930, Validation Accuracy:  0.934, Loss:  0.078\n",
      "Epoch  44 Batch   38/78 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  0.152\n",
      "Epoch  44 Batch   39/78 - Train Accuracy:  0.971, Validation Accuracy:  0.943, Loss:  0.054\n",
      "Epoch  44 Batch   40/78 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  0.114\n",
      "Epoch  44 Batch   41/78 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  0.052\n",
      "Epoch  44 Batch   42/78 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.062\n",
      "Epoch  44 Batch   43/78 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  0.137\n",
      "Epoch  44 Batch   44/78 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  0.059\n",
      "Epoch  44 Batch   45/78 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  0.047\n",
      "Epoch  44 Batch   46/78 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  0.058\n",
      "Epoch  44 Batch   47/78 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  0.051\n",
      "Epoch  44 Batch   48/78 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  0.075\n",
      "Epoch  44 Batch   49/78 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  0.081\n",
      "Epoch  44 Batch   50/78 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  0.054\n",
      "Epoch  44 Batch   51/78 - Train Accuracy:  0.990, Validation Accuracy:  0.972, Loss:  0.044\n",
      "Epoch  44 Batch   52/78 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  0.060\n",
      "Epoch  44 Batch   53/78 - Train Accuracy:  0.988, Validation Accuracy:  0.956, Loss:  0.039\n",
      "Epoch  44 Batch   54/78 - Train Accuracy:  0.985, Validation Accuracy:  0.964, Loss:  0.060\n",
      "Epoch  44 Batch   55/78 - Train Accuracy:  0.999, Validation Accuracy:  0.979, Loss:  0.046\n",
      "Epoch  44 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.982, Loss:  0.037\n",
      "Epoch  44 Batch   57/78 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  0.039\n",
      "Epoch  44 Batch   58/78 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  0.040\n",
      "Epoch  44 Batch   59/78 - Train Accuracy:  0.988, Validation Accuracy:  0.979, Loss:  0.040\n",
      "Epoch  44 Batch   60/78 - Train Accuracy:  0.972, Validation Accuracy:  0.980, Loss:  0.037\n",
      "Epoch  44 Batch   61/78 - Train Accuracy:  0.997, Validation Accuracy:  0.980, Loss:  0.040\n",
      "Epoch  44 Batch   62/78 - Train Accuracy:  0.984, Validation Accuracy:  0.989, Loss:  0.046\n",
      "Epoch  44 Batch   63/78 - Train Accuracy:  0.990, Validation Accuracy:  0.983, Loss:  0.032\n",
      "Epoch  44 Batch   64/78 - Train Accuracy:  0.982, Validation Accuracy:  0.981, Loss:  0.032\n",
      "Epoch  44 Batch   65/78 - Train Accuracy:  0.987, Validation Accuracy:  0.975, Loss:  0.032\n",
      "Epoch  44 Batch   66/78 - Train Accuracy:  0.993, Validation Accuracy:  0.979, Loss:  0.025\n",
      "Epoch  44 Batch   67/78 - Train Accuracy:  0.990, Validation Accuracy:  0.977, Loss:  0.024\n",
      "Epoch  44 Batch   68/78 - Train Accuracy:  0.996, Validation Accuracy:  0.981, Loss:  0.027\n",
      "Epoch  44 Batch   69/78 - Train Accuracy:  0.997, Validation Accuracy:  0.979, Loss:  0.022\n",
      "Epoch  44 Batch   70/78 - Train Accuracy:  0.978, Validation Accuracy:  0.982, Loss:  0.039\n",
      "Epoch  44 Batch   71/78 - Train Accuracy:  0.998, Validation Accuracy:  0.984, Loss:  0.020\n",
      "Epoch  44 Batch   72/78 - Train Accuracy:  0.994, Validation Accuracy:  0.985, Loss:  0.024\n",
      "Epoch  44 Batch   73/78 - Train Accuracy:  0.990, Validation Accuracy:  0.987, Loss:  0.026\n",
      "Epoch  44 Batch   74/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.028\n",
      "Epoch  44 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  44 Batch   76/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.025\n",
      "Epoch  45 Batch    0/78 - Train Accuracy:  0.990, Validation Accuracy:  0.985, Loss:  0.023\n",
      "Epoch  45 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.984, Loss:  0.017\n",
      "Epoch  45 Batch    2/78 - Train Accuracy:  0.994, Validation Accuracy:  0.985, Loss:  0.019\n",
      "Epoch  45 Batch    3/78 - Train Accuracy:  0.999, Validation Accuracy:  0.989, Loss:  0.022\n",
      "Epoch  45 Batch    4/78 - Train Accuracy:  0.992, Validation Accuracy:  0.989, Loss:  0.019\n",
      "Epoch  45 Batch    5/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  45 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.018\n",
      "Epoch  45 Batch    7/78 - Train Accuracy:  0.993, Validation Accuracy:  0.989, Loss:  0.021\n",
      "Epoch  45 Batch    8/78 - Train Accuracy:  0.996, Validation Accuracy:  0.988, Loss:  0.019\n",
      "Epoch  45 Batch    9/78 - Train Accuracy:  0.992, Validation Accuracy:  0.988, Loss:  0.020\n",
      "Epoch  45 Batch   10/78 - Train Accuracy:  0.994, Validation Accuracy:  0.989, Loss:  0.020\n",
      "Epoch  45 Batch   11/78 - Train Accuracy:  0.994, Validation Accuracy:  0.989, Loss:  0.024\n",
      "Epoch  45 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  45 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.019\n",
      "Epoch  45 Batch   14/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  45 Batch   15/78 - Train Accuracy:  0.990, Validation Accuracy:  0.990, Loss:  0.023\n",
      "Epoch  45 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  45 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  45 Batch   18/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.024\n",
      "Epoch  45 Batch   19/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  45 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  45 Batch   21/78 - Train Accuracy:  0.990, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  45 Batch   22/78 - Train Accuracy:  0.997, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  45 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.017\n",
      "Epoch  45 Batch   24/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.015\n",
      "Epoch  45 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.981, Loss:  0.015\n",
      "Epoch  45 Batch   26/78 - Train Accuracy:  0.997, Validation Accuracy:  0.982, Loss:  0.021\n",
      "Epoch  45 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.981, Loss:  0.018\n",
      "Epoch  45 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.988, Loss:  0.017\n",
      "Epoch  45 Batch   29/78 - Train Accuracy:  0.990, Validation Accuracy:  0.982, Loss:  0.019\n",
      "Epoch  45 Batch   30/78 - Train Accuracy:  0.998, Validation Accuracy:  0.980, Loss:  0.019\n",
      "Epoch  45 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.016\n",
      "Epoch  45 Batch   32/78 - Train Accuracy:  0.998, Validation Accuracy:  0.981, Loss:  0.019\n",
      "Epoch  45 Batch   33/78 - Train Accuracy:  0.981, Validation Accuracy:  0.983, Loss:  0.025\n",
      "Epoch  45 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.980, Loss:  0.015\n",
      "Epoch  45 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  45 Batch   36/78 - Train Accuracy:  0.998, Validation Accuracy:  0.980, Loss:  0.021\n",
      "Epoch  45 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.017\n",
      "Epoch  45 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.974, Loss:  0.017\n",
      "Epoch  45 Batch   39/78 - Train Accuracy:  0.997, Validation Accuracy:  0.982, Loss:  0.021\n",
      "Epoch  45 Batch   40/78 - Train Accuracy:  0.993, Validation Accuracy:  0.981, Loss:  0.015\n",
      "Epoch  45 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  45 Batch   42/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  45 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.021\n",
      "Epoch  45 Batch   44/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.016\n",
      "Epoch  45 Batch   45/78 - Train Accuracy:  0.992, Validation Accuracy:  0.984, Loss:  0.019\n",
      "Epoch  45 Batch   46/78 - Train Accuracy:  0.998, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  45 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.016\n",
      "Epoch  45 Batch   48/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  45 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.021\n",
      "Epoch  45 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.021\n",
      "Epoch  45 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.013\n",
      "Epoch  45 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  45 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  45 Batch   54/78 - Train Accuracy:  0.996, Validation Accuracy:  0.983, Loss:  0.018\n",
      "Epoch  45 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  45 Batch   56/78 - Train Accuracy:  0.998, Validation Accuracy:  0.987, Loss:  0.017\n",
      "Epoch  45 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.017\n",
      "Epoch  45 Batch   58/78 - Train Accuracy:  0.998, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  45 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.014\n",
      "Epoch  45 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  45 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  45 Batch   62/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  45 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.017\n",
      "Epoch  45 Batch   64/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  45 Batch   65/78 - Train Accuracy:  0.992, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  45 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  45 Batch   67/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  45 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.015\n",
      "Epoch  45 Batch   69/78 - Train Accuracy:  0.998, Validation Accuracy:  0.989, Loss:  0.013\n",
      "Epoch  45 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.989, Loss:  0.023\n",
      "Epoch  45 Batch   71/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  45 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  45 Batch   73/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  45 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.017\n",
      "Epoch  45 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  45 Batch   76/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.018\n",
      "Epoch  46 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  46 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  46 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  46 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.016\n",
      "Epoch  46 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  46 Batch    5/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  46 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.015\n",
      "Epoch  46 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  46 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  46 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  46 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  46 Batch   11/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.017\n",
      "Epoch  46 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  46 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  46 Batch   14/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  46 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.018\n",
      "Epoch  46 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.017\n",
      "Epoch  46 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  46 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  46 Batch   19/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  46 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  46 Batch   21/78 - Train Accuracy:  0.994, Validation Accuracy:  0.985, Loss:  0.017\n",
      "Epoch  46 Batch   22/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.016\n",
      "Epoch  46 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  46 Batch   24/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  46 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  46 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.017\n",
      "Epoch  46 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.015\n",
      "Epoch  46 Batch   28/78 - Train Accuracy:  0.993, Validation Accuracy:  0.983, Loss:  0.014\n",
      "Epoch  46 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.015\n",
      "Epoch  46 Batch   30/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.015\n",
      "Epoch  46 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.013\n",
      "Epoch  46 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  46 Batch   33/78 - Train Accuracy:  0.988, Validation Accuracy:  0.987, Loss:  0.020\n",
      "Epoch  46 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.013\n",
      "Epoch  46 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.982, Loss:  0.017\n",
      "Epoch  46 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.977, Loss:  0.016\n",
      "Epoch  46 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.013\n",
      "Epoch  46 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.013\n",
      "Epoch  46 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.016\n",
      "Epoch  46 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  46 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  46 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  46 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.018\n",
      "Epoch  46 Batch   44/78 - Train Accuracy:  0.997, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  46 Batch   45/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  46 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  46 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  46 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  46 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.019\n",
      "Epoch  46 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.018\n",
      "Epoch  46 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  46 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  46 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  46 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  46 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  46 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  46 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  46 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  46 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  46 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.015\n",
      "Epoch  46 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.013\n",
      "Epoch  46 Batch   62/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  46 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  46 Batch   64/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  46 Batch   65/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  46 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  46 Batch   67/78 - Train Accuracy:  0.993, Validation Accuracy:  0.988, Loss:  0.012\n",
      "Epoch  46 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.013\n",
      "Epoch  46 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.012\n",
      "Epoch  46 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.988, Loss:  0.021\n",
      "Epoch  46 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  46 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.013\n",
      "Epoch  46 Batch   73/78 - Train Accuracy:  0.993, Validation Accuracy:  0.989, Loss:  0.014\n",
      "Epoch  46 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.015\n",
      "Epoch  46 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  46 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.991, Loss:  0.016\n",
      "Epoch  47 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  47 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  47 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  47 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  47 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  47 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  47 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  47 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  47 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  47 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  47 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  47 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  47 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.015\n",
      "Epoch  47 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.015\n",
      "Epoch  47 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  47 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  47 Batch   19/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  47 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  47 Batch   21/78 - Train Accuracy:  0.994, Validation Accuracy:  0.985, Loss:  0.015\n",
      "Epoch  47 Batch   22/78 - Train Accuracy:  0.997, Validation Accuracy:  0.985, Loss:  0.014\n",
      "Epoch  47 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  47 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  47 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  47 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.014\n",
      "Epoch  47 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.013\n",
      "Epoch  47 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  47 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  47 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  47 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  47 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   33/78 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  0.018\n",
      "Epoch  47 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.011\n",
      "Epoch  47 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.978, Loss:  0.015\n",
      "Epoch  47 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.014\n",
      "Epoch  47 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.012\n",
      "Epoch  47 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.012\n",
      "Epoch  47 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.015\n",
      "Epoch  47 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  47 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  47 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  47 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.016\n",
      "Epoch  47 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  47 Batch   45/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  47 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  47 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  47 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  47 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.987, Loss:  0.017\n",
      "Epoch  47 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.016\n",
      "Epoch  47 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  47 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  47 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  47 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  47 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  47 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  47 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.011\n",
      "Epoch  47 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  47 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  47 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  47 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  47 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  47 Batch   65/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  47 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  47 Batch   67/78 - Train Accuracy:  0.993, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  47 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.012\n",
      "Epoch  47 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  47 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.989, Loss:  0.019\n",
      "Epoch  47 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  47 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.012\n",
      "Epoch  47 Batch   73/78 - Train Accuracy:  0.993, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  47 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  47 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  47 Batch   76/78 - Train Accuracy:  0.998, Validation Accuracy:  0.989, Loss:  0.015\n",
      "Epoch  48 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  48 Batch    1/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  48 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  48 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  48 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  48 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch    7/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  48 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  48 Batch    9/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  48 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  48 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  48 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  48 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  48 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  48 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  48 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  48 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  48 Batch   19/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  48 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  48 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.014\n",
      "Epoch  48 Batch   22/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  48 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  48 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  48 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  48 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.013\n",
      "Epoch  48 Batch   27/78 - Train Accuracy:  0.994, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  48 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  48 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  48 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  48 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  48 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  48 Batch   33/78 - Train Accuracy:  0.988, Validation Accuracy:  0.990, Loss:  0.016\n",
      "Epoch  48 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.010\n",
      "Epoch  48 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.978, Loss:  0.014\n",
      "Epoch  48 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.013\n",
      "Epoch  48 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.011\n",
      "Epoch  48 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.011\n",
      "Epoch  48 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.014\n",
      "Epoch  48 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  48 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  48 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  48 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.015\n",
      "Epoch  48 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  48 Batch   45/78 - Train Accuracy:  0.998, Validation Accuracy:  0.988, Loss:  0.013\n",
      "Epoch  48 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  48 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  48 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  48 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  48 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  48 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  48 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  48 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  48 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  48 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.013\n",
      "Epoch  48 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  48 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  48 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  48 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  48 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  48 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  48 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  48 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  48 Batch   67/78 - Train Accuracy:  0.993, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  48 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  48 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  48 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.988, Loss:  0.018\n",
      "Epoch  48 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  48 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  48 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.012\n",
      "Epoch  48 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  48 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  48 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.014\n",
      "Epoch  49 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  49 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  49 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  49 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  49 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  49 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  49 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  49 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  49 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  49 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  49 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  49 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  49 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  49 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  49 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  49 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  49 Batch   19/78 - Train Accuracy:  0.997, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  49 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  49 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.013\n",
      "Epoch  49 Batch   22/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  49 Batch   23/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  49 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  49 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  49 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  49 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.012\n",
      "Epoch  49 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.011\n",
      "Epoch  49 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  49 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  49 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  49 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  49 Batch   33/78 - Train Accuracy:  0.988, Validation Accuracy:  0.990, Loss:  0.015\n",
      "Epoch  49 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  49 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.982, Loss:  0.013\n",
      "Epoch  49 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.978, Loss:  0.012\n",
      "Epoch  49 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  49 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  49 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.013\n",
      "Epoch  49 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  49 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  49 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  49 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.014\n",
      "Epoch  49 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  49 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.012\n",
      "Epoch  49 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  49 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  49 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  49 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  49 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  49 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  49 Batch   52/78 - Train Accuracy:  0.991, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  49 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  49 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  49 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  49 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  49 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  49 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  49 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  49 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  49 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  49 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  49 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  49 Batch   67/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  49 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  49 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  49 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.988, Loss:  0.016\n",
      "Epoch  49 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  49 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  49 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  49 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  49 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  49 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.013\n",
      "Epoch  50 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  50 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  50 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  50 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  50 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  50 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  50 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  50 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  50 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  50 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  50 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  50 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  50 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  50 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  50 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  50 Batch   22/78 - Train Accuracy:  0.999, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  50 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  50 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  50 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  50 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  50 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.983, Loss:  0.011\n",
      "Epoch  50 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  50 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  50 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  50 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  50 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  50 Batch   33/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  50 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  50 Batch   35/78 - Train Accuracy:  0.993, Validation Accuracy:  0.982, Loss:  0.012\n",
      "Epoch  50 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.011\n",
      "Epoch  50 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  50 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  50 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.012\n",
      "Epoch  50 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  50 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.013\n",
      "Epoch  50 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  50 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  50 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  50 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  50 Batch   48/78 - Train Accuracy:  0.998, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  50 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.013\n",
      "Epoch  50 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  50 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  50 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  50 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  50 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  50 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  50 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  50 Batch   60/78 - Train Accuracy:  0.994, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  50 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  50 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  50 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  50 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  50 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  50 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  50 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  50 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  50 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  50 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.987, Loss:  0.015\n",
      "Epoch  50 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  50 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  50 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  50 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  50 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  50 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  51 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  51 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  51 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  51 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  51 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  51 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  51 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  51 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  51 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.011\n",
      "Epoch  51 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  51 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  51 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  51 Batch   16/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  51 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  51 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  51 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  51 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  51 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.012\n",
      "Epoch  51 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  51 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  51 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  51 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  51 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.011\n",
      "Epoch  51 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  51 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  51 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  51 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  51 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  51 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  51 Batch   33/78 - Train Accuracy:  0.991, Validation Accuracy:  0.990, Loss:  0.014\n",
      "Epoch  51 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  51 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.011\n",
      "Epoch  51 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  51 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  51 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  51 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.011\n",
      "Epoch  51 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  51 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  51 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  51 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.012\n",
      "Epoch  51 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  51 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  51 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  51 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  51 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  51 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.012\n",
      "Epoch  51 Batch   50/78 - Train Accuracy:  0.996, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  51 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  51 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  51 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  51 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  51 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  51 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  51 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  51 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  51 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  51 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  51 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  51 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  51 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  51 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  51 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  51 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  51 Batch   70/78 - Train Accuracy:  0.989, Validation Accuracy:  0.984, Loss:  0.014\n",
      "Epoch  51 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  51 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.009\n",
      "Epoch  51 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  51 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  51 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  51 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.012\n",
      "Epoch  52 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  52 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  52 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  52 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  52 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.011\n",
      "Epoch  52 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  52 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  52 Batch   15/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  52 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  52 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  52 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  52 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.011\n",
      "Epoch  52 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  52 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  52 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  52 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  52 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.010\n",
      "Epoch  52 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  52 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  52 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  52 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  52 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  52 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  52 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.990, Loss:  0.013\n",
      "Epoch  52 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  52 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.011\n",
      "Epoch  52 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  52 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  52 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  52 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.011\n",
      "Epoch  52 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  52 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  52 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.011\n",
      "Epoch  52 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  52 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  52 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  52 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  52 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  52 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.012\n",
      "Epoch  52 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  52 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  52 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  52 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  52 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.010\n",
      "Epoch  52 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  52 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  52 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  52 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  52 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  52 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  52 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  52 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  52 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  52 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  52 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.013\n",
      "Epoch  52 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  52 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  52 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  52 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  52 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  52 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.011\n",
      "Epoch  53 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  53 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  53 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  53 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch    4/78 - Train Accuracy:  0.996, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  53 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  53 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  53 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  53 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  53 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  53 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  53 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  53 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  53 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  53 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  53 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  53 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  53 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  53 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  53 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  53 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  53 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  53 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  53 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  53 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  53 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  53 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.012\n",
      "Epoch  53 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  53 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  53 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  53 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  53 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  53 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.010\n",
      "Epoch  53 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  53 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  53 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  53 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.011\n",
      "Epoch  53 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  53 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  53 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  53 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  53 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  53 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  53 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  53 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  53 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  53 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  53 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  53 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  53 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  53 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  53 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  53 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  53 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  53 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  53 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  53 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  53 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.012\n",
      "Epoch  53 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  53 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.008\n",
      "Epoch  53 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  53 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  53 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  53 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  54 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  54 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  54 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  54 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  54 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  54 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  54 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  54 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  54 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  54 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  54 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  54 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  54 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  54 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  54 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.010\n",
      "Epoch  54 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  54 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  54 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  54 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  54 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  54 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  54 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  54 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  54 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  54 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  54 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  54 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  54 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  54 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  54 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  54 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  54 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  54 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  54 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.009\n",
      "Epoch  54 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.010\n",
      "Epoch  54 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  54 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  54 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  54 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  54 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  54 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  54 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  54 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  54 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  54 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  54 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  54 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  54 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  54 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  54 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  54 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  54 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  54 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  54 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  54 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  54 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.984, Loss:  0.011\n",
      "Epoch  54 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.006\n",
      "Epoch  54 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  54 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  54 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  54 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  54 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.010\n",
      "Epoch  55 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  55 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  55 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  55 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  55 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  55 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  55 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  55 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  55 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  55 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  55 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  55 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  55 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  55 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  55 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  55 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  55 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.006\n",
      "Epoch  55 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  55 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  55 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  55 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  55 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  55 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  55 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  55 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  55 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.011\n",
      "Epoch  55 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  55 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  55 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  55 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  55 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  55 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.009\n",
      "Epoch  55 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  55 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  55 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  55 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  55 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  55 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  55 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  55 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  55 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  55 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  55 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  55 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  55 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  55 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  55 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   57/78 - Train Accuracy:  0.997, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  55 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  55 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  55 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  55 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  55 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  55 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  55 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  55 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.010\n",
      "Epoch  55 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.006\n",
      "Epoch  55 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.007\n",
      "Epoch  55 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  55 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  55 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  55 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  56 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  56 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  56 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  56 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  56 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  56 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  56 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  56 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  56 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  56 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  56 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  56 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  56 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.009\n",
      "Epoch  56 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  56 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  56 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.006\n",
      "Epoch  56 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  56 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  56 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  56 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  56 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  56 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  56 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  56 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  56 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.010\n",
      "Epoch  56 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  56 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  56 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  56 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  56 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  56 Batch   40/78 - Train Accuracy:  0.996, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  56 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.008\n",
      "Epoch  56 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.009\n",
      "Epoch  56 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  56 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  56 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  56 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  56 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  56 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  56 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  56 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  56 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  56 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  56 Batch   57/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  56 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  56 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   60/78 - Train Accuracy:  0.993, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  56 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  56 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  56 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  56 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  56 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  56 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  56 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  56 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.006\n",
      "Epoch  56 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  56 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  56 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  56 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  56 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.009\n",
      "Epoch  57 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  57 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  57 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  57 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  57 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  57 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  57 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  57 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  57 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  57 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  57 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  57 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  57 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  57 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  57 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  57 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  57 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  57 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  57 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  57 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  57 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  57 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  57 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  57 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  57 Batch   33/78 - Train Accuracy:  0.997, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  57 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  57 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  57 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  57 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  57 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  57 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.008\n",
      "Epoch  57 Batch   40/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  57 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  57 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  57 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  57 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  57 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  57 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  57 Batch   49/78 - Train Accuracy:  0.994, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  57 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  57 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  57 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  57 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.993, Loss:  0.006\n",
      "Epoch  57 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.007\n",
      "Epoch  57 Batch   57/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.007\n",
      "Epoch  57 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  57 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  57 Batch   60/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  57 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  57 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  57 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  57 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.009\n",
      "Epoch  57 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.984, Loss:  0.005\n",
      "Epoch  57 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  57 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  57 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  57 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  58 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.006\n",
      "Epoch  58 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  58 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  58 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  58 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  58 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  58 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  58 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  58 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  58 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  58 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.005\n",
      "Epoch  58 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.007\n",
      "Epoch  58 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  58 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.004\n",
      "Epoch  58 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.008\n",
      "Epoch  58 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  58 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  58 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  58 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  58 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  58 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  58 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  58 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  58 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  58 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  58 Batch   33/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.009\n",
      "Epoch  58 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  58 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  58 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  58 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  58 Batch   40/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.006\n",
      "Epoch  58 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  58 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  58 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  58 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  58 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  58 Batch   49/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  58 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  58 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  58 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  58 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.994, Loss:  0.006\n",
      "Epoch  58 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.994, Loss:  0.006\n",
      "Epoch  58 Batch   57/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.007\n",
      "Epoch  58 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.007\n",
      "Epoch  58 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   60/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  58 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  58 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  58 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  58 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  58 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.008\n",
      "Epoch  58 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  58 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  58 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  58 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  58 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.008\n",
      "Epoch  59 Batch    0/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.005\n",
      "Epoch  59 Batch    1/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.004\n",
      "Epoch  59 Batch    2/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  59 Batch    3/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch    4/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch    5/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch    6/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch    7/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  59 Batch    8/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.005\n",
      "Epoch  59 Batch    9/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   10/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   11/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  59 Batch   12/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch   13/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch   14/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.004\n",
      "Epoch  59 Batch   15/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch   16/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch   17/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.005\n",
      "Epoch  59 Batch   18/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  59 Batch   19/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  59 Batch   20/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.004\n",
      "Epoch  59 Batch   21/78 - Train Accuracy:  0.993, Validation Accuracy:  0.985, Loss:  0.007\n",
      "Epoch  59 Batch   22/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  59 Batch   23/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.006\n",
      "Epoch  59 Batch   24/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  59 Batch   25/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  59 Batch   26/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  59 Batch   27/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  59 Batch   28/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  59 Batch   29/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  59 Batch   30/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  59 Batch   31/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  59 Batch   32/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.006\n",
      "Epoch  59 Batch   33/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  59 Batch   34/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  59 Batch   35/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  59 Batch   36/78 - Train Accuracy:  1.000, Validation Accuracy:  0.991, Loss:  0.006\n",
      "Epoch  59 Batch   37/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  59 Batch   38/78 - Train Accuracy:  1.000, Validation Accuracy:  0.985, Loss:  0.005\n",
      "Epoch  59 Batch   39/78 - Train Accuracy:  1.000, Validation Accuracy:  0.982, Loss:  0.007\n",
      "Epoch  59 Batch   40/78 - Train Accuracy:  1.000, Validation Accuracy:  0.987, Loss:  0.006\n",
      "Epoch  59 Batch   41/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  59 Batch   42/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  59 Batch   43/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.008\n",
      "Epoch  59 Batch   44/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  59 Batch   45/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   46/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  59 Batch   47/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.005\n",
      "Epoch  59 Batch   48/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.004\n",
      "Epoch  59 Batch   49/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.007\n",
      "Epoch  59 Batch   50/78 - Train Accuracy:  1.000, Validation Accuracy:  0.988, Loss:  0.008\n",
      "Epoch  59 Batch   51/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  59 Batch   52/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   53/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.004\n",
      "Epoch  59 Batch   54/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   55/78 - Train Accuracy:  1.000, Validation Accuracy:  0.994, Loss:  0.006\n",
      "Epoch  59 Batch   56/78 - Train Accuracy:  1.000, Validation Accuracy:  0.994, Loss:  0.006\n",
      "Epoch  59 Batch   57/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.006\n",
      "Epoch  59 Batch   58/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.006\n",
      "Epoch  59 Batch   59/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  59 Batch   60/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   61/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  59 Batch   62/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  59 Batch   63/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   64/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   65/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.007\n",
      "Epoch  59 Batch   66/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.004\n",
      "Epoch  59 Batch   67/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  59 Batch   68/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  59 Batch   69/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  59 Batch   70/78 - Train Accuracy:  0.996, Validation Accuracy:  0.989, Loss:  0.007\n",
      "Epoch  59 Batch   71/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.005\n",
      "Epoch  59 Batch   72/78 - Train Accuracy:  1.000, Validation Accuracy:  0.993, Loss:  0.005\n",
      "Epoch  59 Batch   73/78 - Train Accuracy:  1.000, Validation Accuracy:  0.989, Loss:  0.006\n",
      "Epoch  59 Batch   74/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.006\n",
      "Epoch  59 Batch   75/78 - Train Accuracy:  1.000, Validation Accuracy:  0.990, Loss:  0.005\n",
      "Epoch  59 Batch   76/78 - Train Accuracy:  1.000, Validation Accuracy:  0.996, Loss:  0.007\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "\n",
    "train_source = source_ids[batch_size:]\n",
    "train_target = target_ids[batch_size:]\n",
    "\n",
    "valid_source = source_ids[:batch_size]\n",
    "valid_target = target_ids[:batch_size]\n",
    "\n",
    "sess.run(tf.global_variables_initializer())\n",
    "\n",
    "for epoch_i in range(epochs):\n",
    "    for batch_i, (source_batch, target_batch) in enumerate(\n",
    "            helper.batch_data(train_source, train_target, batch_size)):\n",
    "        _, loss = sess.run(\n",
    "            [train_op, cost],\n",
    "            {input_data: source_batch, targets: target_batch, lr: learning_rate})\n",
    "        batch_train_logits = sess.run(\n",
    "            inference_logits,\n",
    "            {input_data: source_batch})\n",
    "        batch_valid_logits = sess.run(\n",
    "            inference_logits,\n",
    "            {input_data: valid_source})\n",
    "\n",
    "        train_acc = np.mean(np.equal(target_batch, np.argmax(batch_train_logits, 2)))\n",
    "        valid_acc = np.mean(np.equal(valid_target, np.argmax(batch_valid_logits, 2)))\n",
    "        print('Epoch {:>3} Batch {:>4}/{} - Train Accuracy: {:>6.3f}, Validation Accuracy: {:>6.3f}, Loss: {:>6.3f}'\n",
    "              .format(epoch_i, batch_i, len(source_ids) // batch_size, train_acc, valid_acc, loss))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Prediction"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Input\n",
      "  Word Ids:      [20, 18, 28, 28, 10, 0, 0]\n",
      "  Input Words: ['h', 'e', 'l', 'l', 'o', '<pad>', '<pad>']\n",
      "\n",
      "Prediction\n",
      "  Word Ids:      [18, 20, 28, 28, 10, 0, 0]\n",
      "  Chatbot Answer Words: ['e', 'h', 'l', 'l', 'o', '<pad>', '<pad>']\n"
     ]
    }
   ],
   "source": [
    "input_sentence = 'hello'\n",
    "\n",
    "\n",
    "input_sentence = [source_letter_to_int.get(word, source_letter_to_int['<unk>']) for word in input_sentence.lower()]\n",
    "input_sentence = input_sentence + [0] * (sequence_length - len(input_sentence))\n",
    "batch_shell = np.zeros((batch_size, sequence_length))\n",
    "batch_shell[0] = input_sentence\n",
    "chatbot_logits = sess.run(inference_logits, {input_data: batch_shell})[0]\n",
    "\n",
    "print('Input')\n",
    "print('  Word Ids:      {}'.format([i for i in input_sentence]))\n",
    "print('  Input Words: {}'.format([source_int_to_letter[i] for i in input_sentence]))\n",
    "\n",
    "print('\\nPrediction')\n",
    "print('  Word Ids:      {}'.format([i for i in np.argmax(chatbot_logits, 1)]))\n",
    "print('  Chatbot Answer Words: {}'.format([target_int_to_letter[i] for i in np.argmax(chatbot_logits, 1)]))"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}
